WIDER数据集的相关标注，逐一显示landmark dataset所有图片的标注

WIDER数据集的相关标注，逐一显示landmark dataset所有图片的标注 mini菜 2023-06-02 18:43:55 1650
深度学习
Python

本文解释如何显示WIDER数据集及显示相关标注。

如何显示coco数据集的图片及查看标注的质量请参考前面的文章《保存coco dataset注释为单一文件，并逐一显示所有图片的mask》。

根据libfacedetection.train(https://github.com/ShiqiYu/libfacedetection.train)的数据结构，我们看一下其中的标注trainset.json的效果，

  1. $ tree data/widerface  
  2. data/widerface  
  3. ├── eval\_tools  
  4. ├── wider\_face\_split  
  5. ├── WIDER\_test  
  6. ├── WIDER\_train  
  7. ├── WIDER\_val  
  8. └── trainset.json

文件trainset.json 比较大，直接打开要好久，我摘录几条看一下格式

  2. {
  3. "images":
  4.     [
  5.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_53.jpg", "height": 683, "width": 1024, "id": 0},
  6.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_28.jpg", "height": 736, "width": 1024, "id": 1}, 
  7.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_591.jpg", "height": 936, "width": 1024, "id": 2}, 
  8.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_46.jpg", "height": 520, "width": 1024, "id": 3}, 
  9.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_321.jpg", "height": 1392, "width": 1024, "id": 4}, 
  10.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_946.jpg", "height": 1001, "width": 1024, "id": 5}, 
  11.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_307.jpg", "height": 1139, "width": 1024, "id": 6}, 
  12.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_943.jpg", "height": 1156, "width": 1024, "id": 7},
  13.         {"file_name": "./44--Aerobics/44_Aerobics_Aerobics_44_711.jpg", "height": 1656, "width": 1024, "id": 8},
  14.         ...
  15.         {"file_name": "./27--Spa/27_Spa_Spa_27_110.jpg", "height": 307, "width": 1024, "id": 12860}, 
  16.         {"file_name": "./27--Spa/27_Spa_Spa_27_879.jpg", "height": 1024, "width": 1024, "id": 12861}, 
  17.         {"file_name": "./27--Spa/27_Spa_Spa_27_219.jpg", "height": 682, "width": 1024, "id": 12862}
  18.     ], 
  19.     "annotations": 
  20.     [
  21.         {"segmentation": [[421.1, 133.2, 445.5, 125.5, 432.6, 145.4, 432.3, 159.9, 450.6, 153.4]], "area": 4356.76, "iscrowd": 0, "image_id": 0, "bbox": [411.5, 100.1, 59.6, 73.1], "category_id": 1, "id": 0, "ignore": 0}, 
  22.         {"segmentation": [[537.6, 120.5, 546.8, 119.1, 541.2, 125.2, 539.9, 130.7, 547.1, 129.5]], "area": 585.66, "iscrowd": 0, "image_id": 0, "bbox": [534.4, 110.9, 22.7, 25.8], "category_id": 1, "id": 1, "ignore": 0}, 
  23.         {"segmentation": [[104.5, 152.8, 116.5, 150.9, 109.9, 158.4, 107.3, 164.1, 117.7, 162.5]], "area": 953.2800000000001, "iscrowd": 0, "image_id": 0, "bbox": [99.3, 139.2, 28.8, 33.1], "category_id": 1, "id": 2, "ignore": 0},
  24.         {"segmentation": [[823.0, 102.6, 832.1, 102.6, 826.2, 107.1, 823.6, 112.3, 830.9, 112.2]], "area": 497.96000000000004, "iscrowd": 0, "image_id": 0, "bbox": [819.0, 95.6, 21.1, 23.6], "category_id": 1, "id": 3, "ignore": 0}, 
  25.         {"segmentation": [[955.1, 94.6, 971.3, 96.7, 961.0, 106.2, 954.8, 111.8, 966.8, 113.3]], "area": 1760.5900000000001, "iscrowd": 0, "image_id": 0, "bbox": [945.4, 76.2, 37.7, 46.7], "category_id": 1, "id": 4, "ignore": 0}, 
  26.         {"segmentation": [[597.0, 121.9, 603.2, 121.7, 600.3, 125.3, 598.1, 127.7, 602.5, 127.5]], "area": 195.35999999999999, "iscrowd": 0, "image_id": 0, "bbox": [593.3, 115.6, 13.2, 14.8], "category_id": 1, "id": 5, "ignore": 0}, 
  27.         {"segmentation": [[756.2, 115.3, 762.5, 115.1, 759.5, 118.2, 757.2, 121.5, 762.1, 121.3]], "area": 221.1, "iscrowd": 0, "image_id": 0, "bbox": [752.5, 108.7, 13.4, 16.5], "category_id": 1, "id": 6, "ignore": 0}, 
  28.         {"segmentation": [[358.1, 117.4, 372.8, 116.2, 370.0, 123.7, 361.8, 134.2, 373.6, 133.4]], "area": 1874.5200000000002, "iscrowd": 0, "image_id": 0, "bbox": [340.3, 96.7, 38.1, 49.2], "category_id": 1, "id": 7, "ignore": 0}, 
  29.         {"segmentation": [[379.5, 129.0, 389.0, 129.0, 384.7, 133.6, 380.9, 138.7, 387.5, 138.7]], "area": 552.16, "iscrowd": 0, "image_id": 0, "bbox": [373.1, 116.6, 20.3, 27.2], "category_id": 1, "id": 8, "ignore": 0}, 
  30.         {"segmentation": [[709.0, 126.4, 713.6, 126.1, 711.4, 128.5, 709.7, 130.8, 713.6, 130.6]], "area": 124.23, "iscrowd": 0, "image_id": 0, "bbox": [706.5, 121.5, 10.1, 12.3], "category_id": 1, "id": 9, "ignore": 0},
  31.         {"segmentation": [[572.8, 126.0, 581.4, 126.0, 576.7, 131.5, 574.6, 134.5, 580.3, 134.4]], "area": 371.05, "iscrowd": 0, "image_id": 0, "bbox": [569.0, 116.7, 18.1, 20.5], "category_id": 1, "id": 10, "ignore": 0}, 
  33.         {"segmentation": [[931.5, 271.4, 943.9, 269.6, 936.0, 278.6, 935.2, 286.0, 944.5, 284.4]], "area": 1200.3700000000001, "iscrowd": 0, "image_id": 1, "bbox": [927.0, 255.3, 30.7, 39.1], "category_id": 1, "id": 11, "ignore": 0},
  34.         {"segmentation": [[473.7, 339.6, 481.5, 339.6, 474.1, 345.6, 475.3, 351.7, 481.4, 351.4]], "area": 818.4, "iscrowd": 0, "image_id": 1, "bbox": [471.2, 326.5, 24.8, 33.0], "category_id": 1, "id": 12, "ignore": 0},
  35.         {"segmentation": [[28.5, 326.5, 34.1, 323.5, 31.7, 333.3, 39.8, 337.5, 42.5, 334.7]], "area": 912.0300000000001, "iscrowd": 0, "image_id": 1, "bbox": [23.9, 310.9, 30.1, 30.3], "category_id": 1, "id": 13, "ignore": 0}, 
  36.         {"segmentation": [[413.6, 314.8, 418.6, 315.9, 412.2, 319.4, 412.7, 324.3, 416.4, 324.8]], "area": 477.52, "iscrowd": 0, "image_id": 1, "bbox": [410.3, 305.7, 18.8, 25.4], "category_id": 1, "id": 14, "ignore": 0}, 
  37.         {"segmentation": [[599.5, 263.3, 614.7, 263.0, 603.4, 272.6, 601.1, 283.4, 612.3, 283.2]], "area": 1978.4599999999998, "iscrowd": 0, "image_id": 1, "bbox": [594.8, 242.8, 37.4, 52.9], "category_id": 1, "id": 15, "ignore": 0}, 
  38.         {"segmentation": [[828.2, 290.6, 839.6, 290.0, 832.2, 297.0, 830.0, 303.8, 838.8, 303.3]], "area": 865.8, "iscrowd": 0, "image_id": 1, "bbox": [824.6, 278.5, 26.0, 33.3], "category_id": 1, "id": 16, "ignore": 0},
  39.         ...
  40.         {"segmentation": [[738.1, 329.4, 747.3, 329.3, 741.2, 334.4, 738.8, 340.2, 746.2, 340.1]], "area": 607.7599999999999, "iscrowd": 0, "image_id": 1, "bbox": [734.6, 319.3, 21.4, 28.4], "category_id": 1, "id": 17, "ignore": 0}, 
  41.         {"segmentation": [[876.7, 210.8, 877.4, 211.2, 874.3, 218.4, 878.8, 225.6, 879.2, 225.7]], "area": 847.5, "iscrowd": 0, "image_id": 12862, "bbox": [872.6, 197.0, 22.6, 37.5], "category_id": 1, "id": 113613, "ignore": 0}
  43.     ], 
  44.     "categories":
  45.     [
  46.         {"name": "background", "id": 0}, 
  47.         {"name": "face", "id": 1}
  48.     ]
  49. }

典型的coco数据结构，我基本参考了原来的cocoapi，但也做了不小的改动，主要包括：

  1. 显示方式发生了变化，这次简单地显示成多边形吧（其实也可以用数据点或数字）
  2. mask（RLE）不需要了，因此没有maskutil，无需编译安装，直接python搞定

源码分成两个文件，一个是主文件，随便取个名吧：unknown.py

  1. # @MxTan from SpaceVision SZ Co.Ltd 
  2. #
  3. # @brief  for display landmark annotations piece by piece
  4. #
  5. # ref. windows version cocoapi if you need a mask version
  6. # https://github.com/philferriere/cocoapi
  7. #
  8. #
  10. from CoLandMark import LandMark
  11. import numpy as np
  12. import skimage.io as io #conda install scikit-image
  13. import json
  14. import os
  16. import matplotlib as mpl
  17. mpl.use('TkAgg')
  18. import pylab
  19. import matplotlib.rcsetup as rcsetup
  20. pylab.rcParams['figure.figsize'] = (8.0, 10.0)
  22. dataDir='D:/vsAI/libfacedetectiontrain/data/widerface/WIDER_train/images'
  23. annFile= 'trainset.json'
  25. # initialize COCO api for instance annotations
  26. coco=LandMark(annFile)
  28. # display COCO categories
  29. catIds = coco.getCatIds()
  30. cats = coco.loadCats(catIds)
  31. nms=[cat['name'] for cat in cats] 
  32. print('COCO format categories: \n{}\n'.format(' '.join(nms)))
  34. # recursively display all images and its masks
  35. imgIds = coco.getImgIds()
  36. for id in imgIds: 
  37.     mpl.pyplot.clf()  #put a stop breakpoint here, each cycle you will see a marked image
  38.     annIds = coco.getAnnIds([id], catIds=catIds, iscrowd=None)
  39.     anns = coco.loadAnns(annIds)
  40.     imgIds = coco.getImgIds(imgIds = [id])
  41.     img = coco.loadImgs(imgIds[0])[0]
  43.     #----- save seperate image ----
  44.     #file_name_ext='./WIDER_train/images/' + img['file_name']
  45.     #(filename,extension) = os.path.splitext(file_name_ext)
  46.     #file_path = "coco/" + filename + ".json"
  47.     #data = {"annotations":anns}
  48.     #with open(file_path, 'w') as result_file:
  49.     #    json.dump(data, result_file)
  51.     #----display image----
  52.     file_path = '{}/{}'.format(dataDir,img['file_name'])
  53.     I = io.imread(file_path) 
  54.     #NOTE: the above method is equivalent to the following format
  55.     #I = io.imread('%s/%s'%(dataDir,img['file_name']))  
  57.     mpl.pyplot.imshow(I)
  58.     mpl.pyplot.axis('off')
  59.     coco.showAnns(anns)

标注工具文件取名叫做CoLandMark.py（原来叫COCO.py），里面那个类改名为LandMark，以避免同时使用原来的CoCo时冲突。

  1. __author__ = 'tylin'
  2. __version__ = '2.0'
  3. # A copy from CocoApi, but some modifications are made to cope withe the landmark display
  4. #
  5. # AN alternative import lib for landmark points (NO area rle code required, so we removed the mask part)
  7. # The following API functions are defined:
  8. #  COCO       - COCO api class that loads COCO annotation file and prepare data structures.
  9. #  decodeMask - Decode binary mask M encoded via run-length encoding.
  10. #  encodeMask - Encode binary mask M using run-length encoding.
  11. #  getAnnIds  - Get ann ids that satisfy given filter conditions.
  12. #  getCatIds  - Get cat ids that satisfy given filter conditions.
  13. #  getImgIds  - Get img ids that satisfy given filter conditions.
  14. #  loadAnns   - Load anns with the specified ids.
  15. #  loadCats   - Load cats with the specified ids.
  16. #  loadImgs   - Load imgs with the specified ids.
  17. #  annToMask  - Convert segmentation in an annotation to binary mask.
  18. #  showAnns   - Display the specified annotations.
  19. #  loadRes    - Load algorithm results and create API for accessing them.
  20. #  download   - Download COCO images from mscoco.org server.
  21. # Throughout the API "ann"=annotation, "cat"=category, and "img"=image.
  22. # Help on each functions can be accessed by: "help COCO>function".
  24. # See also COCO>decodeMask,
  25. # COCO>encodeMask, COCO>getAnnIds, COCO>getCatIds,
  26. # COCO>getImgIds, COCO>loadAnns, COCO>loadCats,
  27. # COCO>loadImgs, COCO>annToMask, COCO>showAnns
  29. # Microsoft COCO Toolbox.      version 2.0
  30. # Data, paper, and tutorials available at:  http://mscoco.org/
  31. # Code written by Piotr Dollar and Tsung-Yi Lin, 2014.
  32. # Licensed under the Simplified BSD License [see bsd.txt]
  33. import json
  34. import time
  35. import numpy as np
  36. import copy
  37. import itertools
  39. import matplotlib
  40. matplotlib.use('Agg')
  41. import matplotlib.pyplot as plt
  42. from matplotlib.collections import PatchCollection
  43. from matplotlib.patches import Polygon
  45. import os
  46. from collections import defaultdict
  47. import sys
  48. PYTHON_VERSION = sys.version_info[0]
  49. if PYTHON_VERSION == 2:
  50.     from urllib import urlretrieve
  51. elif PYTHON_VERSION == 3:
  52.     from urllib.request import urlretrieve
  55. def _isArrayLike(obj):
  56.     return hasattr(obj, '__iter__') and hasattr(obj, '__len__')
  59. class LandMark:
  60.     def __init__(self, annotation_file=None):
  61.         """
  62.         Constructor of Microsoft COCO helper class for reading and visualizing annotations.
  63.         :param annotation_file (str): location of annotation file
  64.         :param image_folder (str): location to the folder that hosts images.
  65.         :return:
  66.         """
  67.         # load dataset
  68.         self.dataset,self.anns,self.cats,self.imgs = dict(),dict(),dict(),dict()
  69.         self.imgToAnns, self.catToImgs = defaultdict(list), defaultdict(list)
  70.         if not annotation_file == None:
  71.             print('loading annotations into memory...')
  72.             tic = time.time()
  73.             dataset = json.load(open(annotation_file, 'r'))
  74.             assert type(dataset)==dict, 'annotation file format {} not supported'.format(type(dataset))
  75.             print('Done (t={:0.2f}s)'.format(time.time()- tic))
  76.             self.dataset = dataset
  77.             self.createIndex()
  79.     def createIndex(self):
  80.         # create index
  81.         print('creating index...')
  82.         anns, cats, imgs = {}, {}, {}
  83.         imgToAnns,catToImgs = defaultdict(list),defaultdict(list)
  84.         if 'annotations' in self.dataset:
  85.             for ann in self.dataset['annotations']:
  86.                 imgToAnns[ann['image_id']].append(ann)
  87.                 anns[ann['id']] = ann
  89.         if 'images' in self.dataset:
  90.             for img in self.dataset['images']:
  91.                 imgs[img['id']] = img
  93.         if 'categories' in self.dataset:
  94.             for cat in self.dataset['categories']:
  95.                 cats[cat['id']] = cat
  97.         if 'annotations' in self.dataset and 'categories' in self.dataset:
  98.             for ann in self.dataset['annotations']:
  99.                 catToImgs[ann['category_id']].append(ann['image_id'])
  101.         print('index created!')
  103.         # create class members
  104.         self.anns = anns
  105.         self.imgToAnns = imgToAnns
  106.         self.catToImgs = catToImgs
  107.         self.imgs = imgs
  108.         self.cats = cats
  110.     def info(self):
  111.         """
  112.         Print information about the annotation file.
  113.         :return:
  114.         """
  115.         for key, value in self.dataset['info'].items():
  116.             print('{}: {}'.format(key, value))
  118.     def getAnnIds(self, imgIds=[], catIds=[], areaRng=[], iscrowd=None):
  119.         """
  120.         Get ann ids that satisfy given filter conditions. default skips that filter
  121.         :param imgIds  (int array)     : get anns for given imgs
  122.                catIds  (int array)     : get anns for given cats
  123.                areaRng (float array)   : get anns for given area range (e.g. [0 inf])
  124.                iscrowd (boolean)       : get anns for given crowd label (False or True)
  125.         :return: ids (int array)       : integer array of ann ids
  126.         """
  127.         imgIds = imgIds if _isArrayLike(imgIds) else [imgIds]
  128.         catIds = catIds if _isArrayLike(catIds) else [catIds]
  130.         if len(imgIds) == len(catIds) == len(areaRng) == 0:
  131.             anns = self.dataset['annotations']
  132.         else:
  133.             if not len(imgIds) == 0:
  134.                 lists = [self.imgToAnns[imgId] for imgId in imgIds if imgId in self.imgToAnns]
  135.                 anns = list(itertools.chain.from_iterable(lists))
  136.             else:
  137.                 anns = self.dataset['annotations']
  138.             anns = anns if len(catIds)  == 0 else [ann for ann in anns if ann['category_id'] in catIds]
  139.             anns = anns if len(areaRng) == 0 else [ann for ann in anns if ann['area'] > areaRng[0] and ann['area'] < areaRng[1]]
  140.         if not iscrowd == None:
  141.             ids = [ann['id'] for ann in anns if ann['iscrowd'] == iscrowd]
  142.         else:
  143.             ids = [ann['id'] for ann in anns]
  144.         return ids
  146.     def getCatIds(self, catNms=[], supNms=[], catIds=[]):
  147.         """
  148.         filtering parameters. default skips that filter.
  149.         :param catNms (str array)  : get cats for given cat names
  150.         :param supNms (str array)  : get cats for given supercategory names
  151.         :param catIds (int array)  : get cats for given cat ids
  152.         :return: ids (int array)   : integer array of cat ids
  153.         """
  154.         catNms = catNms if _isArrayLike(catNms) else [catNms]
  155.         supNms = supNms if _isArrayLike(supNms) else [supNms]
  156.         catIds = catIds if _isArrayLike(catIds) else [catIds]
  158.         if len(catNms) == len(supNms) == len(catIds) == 0:
  159.             cats = self.dataset['categories']
  160.         else:
  161.             cats = self.dataset['categories']
  162.             cats = cats if len(catNms) == 0 else [cat for cat in cats if cat['name']          in catNms]
  163.             cats = cats if len(supNms) == 0 else [cat for cat in cats if cat['supercategory'] in supNms]
  164.             cats = cats if len(catIds) == 0 else [cat for cat in cats if cat['id']            in catIds]
  165.         ids = [cat['id'] for cat in cats]
  166.         return ids
  168.     def getImgIds(self, imgIds=[], catIds=[]):
  169.         '''
  170.         Get img ids that satisfy given filter conditions.
  171.         :param imgIds (int array) : get imgs for given ids
  172.         :param catIds (int array) : get imgs with all given cats
  173.         :return: ids (int array)  : integer array of img ids
  174.         '''
  175.         imgIds = imgIds if _isArrayLike(imgIds) else [imgIds]
  176.         catIds = catIds if _isArrayLike(catIds) else [catIds]
  178.         if len(imgIds) == len(catIds) == 0:
  179.             ids = self.imgs.keys()
  180.         else:
  181.             ids = set(imgIds)
  182.             for i, catId in enumerate(catIds):
  183.                 if i == 0 and len(ids) == 0:
  184.                     ids = set(self.catToImgs[catId])
  185.                 else:
  186.                     ids &= set(self.catToImgs[catId])
  187.         return list(ids)
  189.     def loadAnns(self, ids=[]):
  190.         """
  191.         Load anns with the specified ids.
  192.         :param ids (int array)       : integer ids specifying anns
  193.         :return: anns (object array) : loaded ann objects
  194.         """
  195.         if _isArrayLike(ids):
  196.             return [self.anns[id] for id in ids]
  197.         elif type(ids) == int:
  198.             return [self.anns[ids]]
  200.     def loadCats(self, ids=[]):
  201.         """
  202.         Load cats with the specified ids.
  203.         :param ids (int array)       : integer ids specifying cats
  204.         :return: cats (object array) : loaded cat objects
  205.         """
  206.         if _isArrayLike(ids):
  207.             return [self.cats[id] for id in ids]
  208.         elif type(ids) == int:
  209.             return [self.cats[ids]]
  211.     def loadImgs(self, ids=[]):
  212.         """
  213.         Load anns with the specified ids.
  214.         :param ids (int array)       : integer ids specifying img
  215.         :return: imgs (object array) : loaded img objects
  216.         """
  217.         if _isArrayLike(ids):
  218.             return [self.imgs[id] for id in ids]
  219.         elif type(ids) == int:
  220.             return [self.imgs[ids]]
  222.     def showAnns(self, anns):
  223.         """
  224.         Display the specified annotations.
  225.         :param anns (array of object): annotations to display
  226.         :return: None
  227.         """
  228.         if len(anns) == 0:
  229.             return 0
  230.         if 'segmentation' in anns[0] or 'keypoints' in anns[0]:
  231.             datasetType = 'instances'
  232.         elif 'caption' in anns[0]:
  233.             datasetType = 'captions'
  234.         else:
  235.             raise Exception('datasetType not supported')
  236.         if datasetType == 'instances':
  237.             #plt.clf()  #clear the foreground image
  238.             #plt.cla()  # clear the axis
  239.             ax = plt.gca()
  240.             ax.set_autoscale_on(False)
  241.             polygons = []
  242.             color = []
  243.             for ann in anns:
  244.                 c = (np.random.random((1, 3))*0.6+0.4).tolist()[0]
  245.                 if 'segmentation' in ann:
  246.                     if type(ann['segmentation']) == list:
  247.                         # polygon
  248.                         for seg in ann['segmentation']:
  249.                             poly = np.array(seg).reshape((int(len(seg)/2), 2))
  250.                             polygons.append(Polygon(poly))
  251.                             color.append(c)
  252.                     #else:
  253.                         # # mask
  254.                         # t = self.imgs[ann['image_id']]
  255.                         # if type(ann['segmentation']['counts']) == list:
  256.                         #     rle = maskUtils.frPyObjects([ann['segmentation']], t['height'], t['width'])
  257.                         # else:
  258.                         #     rle = [ann['segmentation']]
  259.                         # m = maskUtils.decode(rle)
  260.                         # img = np.ones( (m.shape[0], m.shape[1], 3) )
  261.                         # if ann['iscrowd'] == 1:
  262.                         #     color_mask = np.array([2.0,166.0,101.0])/255
  263.                         # if ann['iscrowd'] == 0:
  264.                         #     color_mask = np.random.random((1, 3)).tolist()[0]
  265.                         # for i in range(3):
  266.                         #     img[:,:,i] = color_mask[i]
  267.                         # ax.imshow(np.dstack( (img, m*0.5) ))
  268.                 if 'keypoints' in ann and type(ann['keypoints']) == list:
  269.                     # turn skeleton into zero-based index
  270.                     sks = np.array(self.loadCats(ann['category_id'])[0]['skeleton'])-1
  271.                     kp = np.array(ann['keypoints'])
  272.                     x = kp[0::3]
  273.                     y = kp[1::3]
  274.                     v = kp[2::3]
  275.                     for sk in sks:
  276.                         if np.all(v[sk]>0):
  277.                             plt.plot(x[sk],y[sk], linewidth=3, color=c)
  278.                     plt.plot(x[v>0], y[v>0],'o',markersize=8, markerfacecolor=c, markeredgecolor='k',markeredgewidth=2)
  279.                     plt.plot(x[v>1], y[v>1],'o',markersize=8, markerfacecolor=c, markeredgecolor=c, markeredgewidth=2)
  280.             #p = PatchCollection(polygons, facecolor=color, linewidths=0, alpha=0.4)
  281.             #ax.add_collection(p)            
  282.             p = PatchCollection(polygons, facecolor='none', edgecolors=color, linewidths=2)
  283.             ax.add_collection(p)
  284.         elif datasetType == 'captions':
  285.             for ann in anns:
  286.                 print(ann['caption'])
  288.     def loadRes(self, resFile):
  289.         """
  290.         Load result file and return a result api object.
  291.         :param   resFile (str)     : file name of result file
  292.         :return: res (obj)         : result api object
  293.         """
  294.         res = LandMark()
  295.         res.dataset['images'] = [img for img in self.dataset['images']]
  297.         print('Loading and preparing results...')
  298.         tic = time.time()
  300.         # Check result type in a way compatible with Python 2 and 3.
  301.         if PYTHON_VERSION == 2:
  302.             is_string =  isinstance(resFile, basestring)  # Python 2
  303.         elif PYTHON_VERSION == 3:
  304.             is_string = isinstance(resFile, str)  # Python 3
  305.         if is_string:
  306.             anns = json.load(open(resFile))
  307.         elif type(resFile) == np.ndarray:
  308.             anns = self.loadNumpyAnnotations(resFile)
  309.         else:
  310.             anns = resFile
  311.         assert type(anns) == list, 'results in not an array of objects'
  312.         annsImgIds = [ann['image_id'] for ann in anns]
  313.         assert set(annsImgIds) == (set(annsImgIds) & set(self.getImgIds())), \
  314.                'Results do not correspond to current coco set'
  315.         if 'caption' in anns[0]:
  316.             imgIds = set([img['id'] for img in res.dataset['images']]) & set([ann['image_id'] for ann in anns])
  317.             res.dataset['images'] = [img for img in res.dataset['images'] if img['id'] in imgIds]
  318.             for id, ann in enumerate(anns):
  319.                 ann['id'] = id+1
  320.         elif 'bbox' in anns[0] and not anns[0]['bbox'] == []:
  321.             res.dataset['categories'] = copy.deepcopy(self.dataset['categories'])
  322.             for id, ann in enumerate(anns):
  323.                 bb = ann['bbox']
  324.                 x1, x2, y1, y2 = [bb[0], bb[0]+bb[2], bb[1], bb[1]+bb[3]]
  325.                 if not 'segmentation' in ann:
  326.                     ann['segmentation'] = [[x1, y1, x1, y2, x2, y2, x2, y1]]
  327.                 ann['area'] = bb[2]*bb[3]
  328.                 ann['id'] = id+1
  329.                 ann['iscrowd'] = 0
  330.         elif 'segmentation' in anns[0]:
  331.             res.dataset['categories'] = copy.deepcopy(self.dataset['categories'])
  332.             for id, ann in enumerate(anns):
  333.                 # now only support compressed RLE format as segmentation results
  334.                 #ann['area'] = maskUtils.area(ann['segmentation'])
  335.                 #if not 'bbox' in ann:
  336.                 #    ann['bbox'] = maskUtils.toBbox(ann['segmentation'])
  337.                 ann['id'] = id+1
  338.                 ann['iscrowd'] = 0
  339.         elif 'keypoints' in anns[0]:
  340.             res.dataset['categories'] = copy.deepcopy(self.dataset['categories'])
  341.             for id, ann in enumerate(anns):
  342.                 s = ann['keypoints']
  343.                 x = s[0::3]
  344.                 y = s[1::3]
  345.                 x0,x1,y0,y1 = np.min(x), np.max(x), np.min(y), np.max(y)
  346.                 ann['area'] = (x1-x0)*(y1-y0)
  347.                 ann['id'] = id + 1
  348.                 ann['bbox'] = [x0,y0,x1-x0,y1-y0]
  349.         print('DONE (t={:0.2f}s)'.format(time.time()- tic))
  351.         res.dataset['annotations'] = anns
  352.         res.createIndex()
  353.         return res
  355.     def download(self, tarDir = None, imgIds = [] ):
  356.         '''
  357.         Download COCO images from mscoco.org server.
  358.         :param tarDir (str): COCO results directory name
  359.                imgIds (list): images to be downloaded
  360.         :return:
  361.         '''
  362.         if tarDir is None:
  363.             print('Please specify target directory')
  364.             return -1
  365.         if len(imgIds) == 0:
  366.             imgs = self.imgs.values()
  367.         else:
  368.             imgs = self.loadImgs(imgIds)
  369.         N = len(imgs)
  370.         if not os.path.exists(tarDir):
  371.             os.makedirs(tarDir)
  372.         for i, img in enumerate(imgs):
  373.             tic = time.time()
  374.             fname = os.path.join(tarDir, img['file_name'])
  375.             if not os.path.exists(fname):
  376.                 urlretrieve(img['coco_url'], fname)
  377.             print('downloaded {}/{} images (t={:0.1f}s)'.format(i, N, time.time()- tic))
  379.     def loadNumpyAnnotations(self, data):
  380.         """
  381.         Convert result data from a numpy array [Nx7] where each row contains {imageID,x1,y1,w,h,score,class}
  382.         :param  data (numpy.ndarray)
  383.         :return: annotations (python nested list)
  384.         """
  385.         print('Converting ndarray to lists...')
  386.         assert(type(data) == np.ndarray)
  387.         print(data.shape)
  388.         assert(data.shape[1] == 7)
  389.         N = data.shape[0]
  390.         ann = []
  391.         for i in range(N):
  392.             if i % 1000000 == 0:
  393.                 print('{}/{}'.format(i,N))
  394.             ann += [{
  395.                 'image_id'  : int(data[i, 0]),
  396.                 'bbox'  : [ data[i, 1], data[i, 2], data[i, 3], data[i, 4] ],
  397.                 'score' : data[i, 5],
  398.                 'category_id': int(data[i, 6]),
  399.                 }]
  400.         return ann
  402.     # def annToRLE(self, ann):
  403.     #     """
  404.     #     Convert annotation which can be polygons, uncompressed RLE to RLE.
  405.     #     :return: binary mask (numpy 2D array)
  406.     #     """
  407.     #     t = self.imgs[ann['image_id']]
  408.     #     h, w = t['height'], t['width']
  409.     #     segm = ann['segmentation']
  410.     #      if type(segm) == list:
  411.     #          # polygon -- a single object might consist of multiple parts
  412.     #          # we merge all parts into one mask rle code
  413.     #          rles = maskUtils.frPyObjects(segm, h, w)
  414.     #          rle = maskUtils.merge(rles)
  415.     #      elif type(segm['counts']) == list:
  416.     #          # uncompressed RLE
  417.     #          rle = maskUtils.frPyObjects(segm, h, w)
  418.     #      else:
  419.     #          # rle
  420.     #         rle = ann['segmentation']
  421.     #     return rle
  423.     # def annToMask(self, ann):
  424.     #     """
  425.     #     Convert annotation which can be polygons, uncompressed RLE, or RLE to binary mask.
  426.     #     :return: binary mask (numpy 2D array)
  427.     #     """
  428.     #     rle = self.annToRLE(ann)
  429.     #     m = maskUtils.decode(rle)
  430.     #     return m

注释掉的部分我没有删除，大家可以和原文比较。

声明：本文内容由易百纳平台入驻作者撰写，文章观点仅代表作者本人，不代表易百纳立场。如有内容侵权或者其他问题，请联系本站进行删除。
mini菜
红包 点赞 收藏 评论 打赏
  • 分享
  • 举报
评论
0个
时间排序
内容存在敏感词
手气红包
    易百纳技术社区暂无数据
相关专栏
关于作者
mini菜

mini菜

暂无个性签名~

原创30
阅读4w
收藏3
点赞1
评论1
TA最新文章
打赏用户 共 0 位
我要创作
分享技术经验，可获取创作收益
分类专栏
热门专栏
置顶时间设置
结束时间
删除原因
  • 广告/SPAM
  • 恶意灌水
  • 违规内容
  • 文不对题
  • 重复发帖
打赏作者
易百纳技术社区
mini菜
您的支持将鼓励我继续创作！
打赏金额：
￥1易百纳技术社区
￥5易百纳技术社区
￥10易百纳技术社区
￥50易百纳技术社区
￥100易百纳技术社区
支付方式：
微信支付
支付宝支付
易百纳技术社区微信支付
易百纳技术社区
打赏成功!

感谢您的打赏，如若您也想被打赏，可前往 发表专栏 哦~

举报反馈

举报类型

  • 内容涉黄/赌/毒
  • 内容侵权/抄袭
  • 政治相关
  • 涉嫌广告
  • 侮辱谩骂
  • 其他

详细说明

审核成功

发布时间设置
立即发布
延迟发布
发布时间：
是否关联周任务-专栏模块
是
否

审核失败

失败原因
备注
拼手气红包 红包规则
祝福语
恭喜发财，大吉大利！
红包金额
元
红包最小金额不能低于5元
红包数量
个
红包数量范围10~50个
余额支付
当前余额：
可前往问答、专栏板块获取收益 去获取
取 消 确 定

小包子的红包

恭喜发财，大吉大利

红包规则
开

已领取20/40，共1.6元 红包规则

    易百纳技术社区