圖像分割就是把圖像分成若幹個特定的、具有獨特性質的區域並提出感興趣目標的技術和過程。它是由圖像處理到圖像分析的關鍵步驟。 所謂圖像分割指的是根據灰度、顏色、紋理和形狀等特征把圖像劃分成若幹互不交迭的區域,並使這些特征在同一區域內呈現出相似性,而在不同區域間呈現出明顯的差異性。

知識薈萃

圖像分割 (Image Segmentation) 專知薈萃

入門學習

  1. A 2017 Guide to Semantic Segmentation with Deep Learning 概述——用深度學習做語義分割
  2. 從全卷積網絡到大型卷積核:深度學習的語義分割全指南
  3. Fully Convolutional Networks
  4. 語義分割中的深度學習方法全解:從FCN、SegNet到各代DeepLab
  5. 圖像語義分割之FCN和CRF
  6. 從特斯拉到計算機視覺之「圖像語義分割」
  7. 計算機視覺之語義分割
  8. Segmentation Results: VOC2012 PASCAL語義分割比賽排名

綜述

  1. A Review on Deep Learning Techniques Applied to Semantic Segmentation Alberto Garcia-Garcia, Sergio Orts-Escolano, Sergiu Oprea, Victor Villena-Martinez, Jose Garcia-Rodriguez 2017
  2. Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art
  3. 基於內容的圖像分割方法綜述 薑 楓 顧 慶 郝慧珍 李 娜 郭延文 陳道蓄 2017

進階論文

  1. U-Net [https://arxiv.org/pdf/1505.04597.pdf]
  2. SegNet [https://arxiv.org/pdf/1511.00561.pdf]
  3. DeepLab [https://arxiv.org/pdf/1606.00915.pdf]
  4. FCN [https://arxiv.org/pdf/1605.06211.pdf]
  5. ENet [https://arxiv.org/pdf/1606.02147.pdf]
  6. LinkNet [https://arxiv.org/pdf/1707.03718.pdf]
  7. DenseNet [https://arxiv.org/pdf/1608.06993.pdf]
  8. Tiramisu [https://arxiv.org/pdf/1611.09326.pdf]
  9. DilatedNet [https://arxiv.org/pdf/1511.07122.pdf]
  10. PixelNet [https://arxiv.org/pdf/1609.06694.pdf]
  11. ICNet [https://arxiv.org/pdf/1704.08545.pdf]
  12. ERFNet [http://www.robesafe.uah.es/personal/eduardo.romera/pdfs/Romera17iv.pdf]
  13. RefineNet [https://arxiv.org/pdf/1611.06612.pdf]
  14. PSPNet [https://arxiv.org/pdf/1612.01105.pdf]
  15. CRFasRNN [http://www.robots.ox.ac.uk/%7Eszheng/papers/CRFasRNN.pdf]
  16. Dilated convolution [https://arxiv.org/pdf/1511.07122.pdf]
  17. DeconvNet [https://arxiv.org/pdf/1505.04366.pdf]
  18. FRRN [https://arxiv.org/pdf/1611.08323.pdf]
  19. GCN [https://arxiv.org/pdf/1703.02719.pdf]
  20. DUC, HDC [https://arxiv.org/pdf/1702.08502.pdf]
  21. Segaware [https://arxiv.org/pdf/1708.04607.pdf]
  22. Semantic Segmentation using Adversarial Networks [https://arxiv.org/pdf/1611.08408.pdf]

綜述

  1. A Review on Deep Learning Techniques Applied to Semantic Segmentation Alberto Garcia-Garcia, Sergio Orts-Escolano, Sergiu Oprea, Victor Villena-Martinez, Jose Garcia-Rodriguez 2017
  2. Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art
  3. 基於內容的圖像分割方法綜述 薑 楓 顧 慶 郝慧珍 李 娜 郭延文 陳道蓄 2017

Tutorial

  1. Semantic Image Segmentation with Deep Learning
  2. A 2017 Guide to Semantic Segmentation with Deep Learning
  3. Image Segmentation with Tensorflow using CNNs and Conditional Random Fields

視頻教程

  1. CS231n: Convolutional Neural Networks for Visual Recognition Lecture 11 Detection and Segmentation
  2. Machine Learning for Semantic Segmentation - Basics of Modern Image Analysis

代碼

Semantic segmentation

  1. U-Net (https://arxiv.org/pdf/1505.04597.pdf)
  2. SegNet (https://arxiv.org/pdf/1511.00561.pdf)
  3. DeepLab (https://arxiv.org/pdf/1606.00915.pdf)
  4. FCN (https://arxiv.org/pdf/1605.06211.pdf)
  5. ENet (https://arxiv.org/pdf/1606.02147.pdf)
  6. LinkNet (https://arxiv.org/pdf/1707.03718.pdf)
  7. DenseNet (https://arxiv.org/pdf/1608.06993.pdf)
  8. Tiramisu (https://arxiv.org/pdf/1611.09326.pdf)
  9. DilatedNet (https://arxiv.org/pdf/1511.07122.pdf)
  10. PixelNet (https://arxiv.org/pdf/1609.06694.pdf)
  11. ICNet (https://arxiv.org/pdf/1704.08545.pdf)
  12. ERFNet (http://www.robesafe.uah.es/personal/eduardo.romera/pdfs/Romera17iv.pdf)
  13. RefineNet (https://arxiv.org/pdf/1611.06612.pdf)
  14. PSPNet (https://arxiv.org/pdf/1612.01105.pdf)
  15. CRFasRNN (http://www.robots.ox.ac.uk/%7Eszheng/papers/CRFasRNN.pdf)
  16. Dilated convolution (https://arxiv.org/pdf/1511.07122.pdf)
  17. DeconvNet (https://arxiv.org/pdf/1505.04366.pdf)
  18. FRRN (https://arxiv.org/pdf/1611.08323.pdf)
  19. GCN (https://arxiv.org/pdf/1703.02719.pdf)
  20. DUC, HDC (https://arxiv.org/pdf/1702.08502.pdf)
  21. Segaware (https://arxiv.org/pdf/1708.04607.pdf)
  22. Semantic Segmentation using Adversarial Networks (https://arxiv.org/pdf/1611.08408.pdf)

Instance aware segmentation

  1. FCIS [https://arxiv.org/pdf/1611.07709.pdf]
  2. MNC [https://arxiv.org/pdf/1512.04412.pdf]
  3. DeepMask [https://arxiv.org/pdf/1506.06204.pdf]
  4. SharpMask [https://arxiv.org/pdf/1603.08695.pdf]
  5. Mask-RCNN [https://arxiv.org/pdf/1703.06870.pdf]
  6. https://github.com/jasjeetIM/Mask-RCNN[Caffe]
  7. RIS [https://arxiv.org/pdf/1511.08250.pdf]
  8. FastMask [https://arxiv.org/pdf/1612.08843.pdf]

Satellite images segmentation

Video segmentation

Autonomous driving

Annotation Tools:

Datasets

  1. Stanford Background Dataset[http://dags.stanford.edu/projects/scenedataset.html]
  2. Sift Flow Dataset[http://people.csail.mit.edu/celiu/SIFTflow/]
  3. Barcelona Dataset[http://www.cs.unc.edu/~jtighe/Papers/ECCV10/]
  4. Microsoft COCO dataset[http://mscoco.org/]
  5. MSRC Dataset[http://research.microsoft.com/en-us/projects/objectclassrecognition/]
  6. LITS Liver Tumor Segmentation Dataset[https://competitions.codalab.org/competitions/15595]
  7. KITTI[http://www.cvlibs.net/datasets/kitti/eval_road.php]
  8. Stanford background dataset[http://dags.stanford.edu/projects/scenedataset.html]
  9. Data from Games dataset[https://download.visinf.tu-darmstadt.de/data/from_games/]
  10. Human parsing dataset[https://github.com/lemondan/HumanParsing-Dataset]
  11. Silenko person database[https://github.com/Maxfashko/CamVid]
  12. Mapillary Vistas Dataset[https://www.mapillary.com/dataset/vistas]
  13. Microsoft AirSim[https://github.com/Microsoft/AirSim]
  14. MIT Scene Parsing Benchmark[http://sceneparsing.csail.mit.edu/]
  15. COCO 2017 Stuff Segmentation Challenge[http://cocodataset.org/#stuff-challenge2017]
  16. ADE20K Dataset[http://groups.csail.mit.edu/vision/datasets/ADE20K/]
  17. INRIA Annotations for Graz-02[http://lear.inrialpes.fr/people/marszalek/data/ig02/]

比賽

  1. MSRC-21 [http://rodrigob.github.io/are_we_there_yet/build/semantic_labeling_datasets_results.html]
  2. Cityscapes [https://www.cityscapes-dataset.com/benchmarks/]
  3. VOC2012 [http://host.robots.ox.ac.uk:8080/leaderboard/displaylb.php?challengeid=11&compid=6]

領域專家

  1. Jonathan Long
  2. Liang-Chieh Chen
  3. Hyeonwoo Noh
  4. Bharath Hariharan
  5. Fisher Yu
  6. Vijay Badrinarayanan
  7. Guosheng Lin

初步版本,水平有限,有錯誤或者不完善的地方,歡迎大家提建議和補充,會一直保持更新,本文為專知內容組原創內容,未經允許不得轉載,如需轉載請發送郵件至fangquanyi@gmail.com或 聯係微信專知小助手(Rancho_Fang)

敬請關注//www.webtourguide.com和關注專知公眾號,獲取第一手AI相關知識

VIP內容

題目:Image Segmentation Using Deep Learning: A Survey

摘要:

圖像分割是圖像處理和計算機視覺領域的一個重要課題,其應用領域包括場景理解、醫學圖像分析、機器人感知、視頻監控、增強現實和圖像壓縮等。文獻中已經發展了各種圖像分割算法。最近,由於深度學習模型在廣泛的視覺應用中取得了成功,已經有大量的工作致力於開發使用深度學習模型的圖像分割方法。在本次調查中,我們對撰寫本文時的文獻進行了全麵的回顧,涵蓋了語義和實例級分割的廣泛的開創性著作,包括全卷積像素標記網絡,編碼器-解碼器架構,多尺度和基於金字塔的方法,遞歸網絡,視覺注意力模型,以及在對抗性環境下的生成模型。我們調查了這些深度學習模型的相似性、優勢和挑戰,研究了最廣泛使用的數據集,報告了性能,並討論了該領域未來的研究方向。

成為VIP會員查看完整內容
0
19
1

最新內容

For the majority of the learning-based segmentation methods, a large quantity of high-quality training data is required. In this paper, we present a novel learning-based segmentation model that could be trained semi- or un- supervised. Specifically, in the unsupervised setting, we parameterize the Active contour without edges (ACWE) framework via a convolutional neural network (ConvNet), and optimize the parameters of the ConvNet using a self-supervised method. In another setting (semi-supervised), the auxiliary segmentation ground truth is used during training. We show that the method provides fast and high-quality bone segmentation in the context of single-photon emission computed tomography (SPECT) image.

0
0
0
下載
預覽

最新論文

For the majority of the learning-based segmentation methods, a large quantity of high-quality training data is required. In this paper, we present a novel learning-based segmentation model that could be trained semi- or un- supervised. Specifically, in the unsupervised setting, we parameterize the Active contour without edges (ACWE) framework via a convolutional neural network (ConvNet), and optimize the parameters of the ConvNet using a self-supervised method. In another setting (semi-supervised), the auxiliary segmentation ground truth is used during training. We show that the method provides fast and high-quality bone segmentation in the context of single-photon emission computed tomography (SPECT) image.

0
0
0
下載
預覽
Top