{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T01:59:45Z","timestamp":1781056785691,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,2,19]],"date-time":"2019-02-19T00:00:00Z","timestamp":1550534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the program of the National Natural Science Foundation of China","award":["61731022"],"award-info":[{"award-number":["61731022"]}]},{"name":"the program of the National Natural Science Foundation of China","award":["61701495"],"award-info":[{"award-number":["61701495"]}]},{"name":"the Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA19090300"],"award-info":[{"award-number":["XDA19090300"]}]},{"name":"the National Key Research and Development Programs of China","award":["2016YFA0600302"],"award-info":[{"award-number":["2016YFA0600302"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Feature matching via local descriptors is one of the most fundamental problems in many computer vision tasks, as well as in the remote sensing image processing community. For example, in terms of remote sensing image registration based on the feature, feature matching is a vital process to determine the quality of transform model. While in the process of feature matching, the quality of feature descriptor determines the matching result directly. At present, the most commonly used descriptor is hand-crafted by the designer\u2019s expertise or intuition. However, it is hard to cover all the different cases, especially for remote sensing images with nonlinear grayscale deformation. Recently, deep learning shows explosive growth and improves the performance of tasks in various fields, especially in the computer vision community. Here, we created remote sensing image training patch samples, named Invar-Dataset in a novel and automatic way, then trained a deep learning convolutional neural network, named DescNet to generate a robust feature descriptor for feature matching. A special experiment was carried out to illustrate that our created training dataset was more helpful to train a network to generate a good feature descriptor. A qualitative experiment was then performed to show that feature descriptor vector learned by the DescNet could be used to register remote sensing images with large gray scale difference successfully. A quantitative experiment was then carried out to illustrate that the feature vector generated by the DescNet could acquire more matched points than those generated by hand-crafted feature Scale Invariant Feature Transform (SIFT) descriptor and other networks. On average, the matched points acquired by DescNet was almost twice those acquired by other methods. Finally, we analyzed the advantages of our created training dataset Invar-Dataset and DescNet and gave the possible development of training deep descriptor network.<\/jats:p>","DOI":"10.3390\/rs11040430","type":"journal-article","created":{"date-parts":[[2019,2,20]],"date-time":"2019-02-20T03:05:52Z","timestamp":1550631952000},"page":"430","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Local Deep Descriptor for Remote Sensing Image Feature Matching"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8375-442X","authenticated-orcid":false,"given":"Yunyun","family":"Dong","sequence":"first","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weili","family":"Jiao","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tengfei","family":"Long","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2001-7542","authenticated-orcid":false,"given":"Lanfa","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute for Cartography, TU Dresden, 01062 Dresden, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guojin","family":"He","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengjuan","family":"Gong","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0272-784X","authenticated-orcid":false,"given":"Yantao","family":"Guo","sequence":"additional","affiliation":[{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Newsam, S., and Yang, Y. (2007, January 7\u20139). Comparing global and interest point descriptors for similarity retrieval in remote sensed imagery. Proceedings of the 15th Annual ACM International Symposium on Advances in Geographic Information Systems, Seattle, WA, USA.","DOI":"10.1145\/1341012.1341024"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2007, January 17\u201322). Object retrieval with large vocabularies and fast spatial matching. Proceedings of the CVPR\u201907 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383172"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.isprsjprs.2016.03.014","article-title":"A survey on object detection in optical remote sensing images","volume":"117","author":"Cheng","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","unstructured":"Fergus, R., Perona, P., and Zisserman, A. (2003, January 18\u201320). Object class recognition by unsupervised scale-invariant learning. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, X., Ai, Y., Zhang, J., and Wang, Z. (2018). A novel affine and contrast invariant descriptor for infrared and visible image registration. Remote Sens., 10.","DOI":"10.3390\/rs10040658"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, Y., Mo, F., and Tao, P. (2017). Matching Multi-Source Optical Satellite Imagery Exploiting a Multi-Stage Approach. Remote Sens., 9.","DOI":"10.3390\/rs9121249"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yang, K., Pan, A., Yang, Y., Zhang, S., Ong, S.H., and Tang, H. (2017). Remote sensing image registration using multiple image features. Remote Sens., 9.","DOI":"10.20944\/preprints201705.0027.v2"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7044","DOI":"10.3390\/rs70607044","article-title":"An ASIFT-based local registration method for satellite imagery","volume":"7","author":"Wang","year":"2015","journal-title":"Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sugimoto, R., Kouyama, T., Kanemura, A., Kato, S., Imamoglu, N., and Nakamura, R. (2018). Automated Attitude Determination for Pushbroom Sensors Based on Robust Image Matching. Remote Sens., 10.","DOI":"10.3390\/rs10101629"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kouyama, T., Kanemura, A., Kato, S., Imamoglu, N., Fukuhara, T., and Nakamura, R. (2017). Satellite attitude determination and map projection based on robust image matching. Remote Sens., 9.","DOI":"10.3390\/rs9010090"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/10255842.2012.670855","article-title":"Medical image registration: A review","volume":"17","author":"Oliveira","year":"2014","journal-title":"Comput. Methods Biomech. Biomed. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1109\/TGRS.2017.2749436","article-title":"A novel image registration method based on phase correlation using low-rank matrix factorization with mixture of Gaussian","volume":"56","author":"Dong","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1080\/03772063.1996.11415890","article-title":"Fourier-mellin transform based image matching algorithm","volume":"42","author":"Dasgupta","year":"1996","journal-title":"IETE J. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dong, Y., Jiao, W., Long, T., He, G., and Gong, C. (2018). An Extension of Phase Correlation-Based Image Registration to Estimate Similarity Transform Using Multiple Polar Fourier Transform. Remote Sens., 10.","DOI":"10.3390\/rs10111719"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, H., Chen, M., Chen, T., and Li, D. (2018). Matching of Remote Sensing Images with Complex Background Variations via Siamese Convolutional Neural Network. Remote Sens., 10.","DOI":"10.3390\/rs10020355"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4516","DOI":"10.1109\/TGRS.2011.2144607","article-title":"Uniform robust scale-invariant feature matching for optical remote sensing images","volume":"49","author":"Sedaghat","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5283","DOI":"10.1109\/TGRS.2015.2420659","article-title":"Remote sensing image matching based on adaptive binning SIFT descriptor","volume":"53","author":"Sedaghat","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"733","DOI":"10.14358\/PERS.81.9.733","article-title":"Accurate affine invariant image matching using oriented least square","volume":"81","author":"Sedaghat","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2321","DOI":"10.1109\/LGRS.2015.2475299","article-title":"Deep Learning Based Feature Selection for Remote Sensing Scene Classification","volume":"12","author":"Zou","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_23","unstructured":"Badrinarayanan, V., Kendall, A., and Cipolla, R. (arXiv, 2015). Segnet: A deep convolutional encoder-decoder architecture for image segmentation, arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gordo, A., Almaz\u00e1n, J., Revaud, J., and Larlus, D. (2016, January 8\u201316). Deep image retrieval: Learning global representations for image search. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46466-4_15"},{"key":"ref_25","unstructured":"Han, X., Leung, T., Jia, Y., Sukthankar, R., and Berg, A.C. (2015, January 7\u201312). Matchnet: Unifying feature and metric learning for patch-based matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tian, Y., Fan, B., and Wu, F. (2017, January 21\u201326). L2-Net: Deep Learning of Discriminative Patch Descriptor in Euclidean Space. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.649"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/TPAMI.2009.77","article-title":"Daisy: An efficient dense descriptor applied to wide-baseline stereo","volume":"32","author":"Tola","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.compmedimag.2014.06.005","article-title":"Improved medical image modality classification using a combination of visual and textual features","volume":"39","author":"Dimitrovski","year":"2015","journal-title":"Comput. Med. Imaging Gr."},{"key":"ref_29","unstructured":"Ioffe, S., and Szegedy, C. (arXiv, 2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift, arXiv."},{"key":"ref_30","unstructured":"Mishchuk, A., Mishkin, D., Radenovic, F., and Matas, J. (2017). Working hard to know your neighbor\u2019s margins: Local descriptor learning loss. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Balntas, V., Riba, E., Ponsa, D., and Mikolajczyk, K. (2016, January 19\u201322). Learning Local Feature Descriptors With Triplets and Shallow Convolutional Neural Networks. Proceedings of the British Machine Vision Association (BMVC) 2016, York, UK.","DOI":"10.5244\/C.30.119"},{"key":"ref_32","unstructured":"Xie, J., He, T., Zhang, Z., Zhang, H., Zhang, Z., and Li, M. (arXiv, 2018). Bag of Tricks for Image Classification with Convolutional Neural Networks, arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1145\/1141911.1141964","article-title":"Photo tourism: Exploring photo collections in 3D","volume":"Volume 25","author":"Snavely","year":"2006","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Balntas, V., Lenc, K., Vedaldi, A., and Mikolajczyk, K. (2017, January 21\u201326). HPatches: A benchmark and evaluation of handcrafted and learned local descriptors. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.410"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Hoffer, E., and Ailon, N. (2015). Deep metric learning using triplet network. International Workshop on Similarity-Based Pattern Recognition, Springer.","DOI":"10.1007\/978-3-319-24261-3_7"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., and Fulkerson, B. (2010, January 25\u201329). VLFeat: An open and portable library of computer vision algorithms. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1874249"},{"key":"ref_39","unstructured":"Johnson, J., Douze, M., and J\u00e9gou, H. (arXiv, 2017). Billion-scale similarity search with gpus, arXiv."},{"key":"ref_40","unstructured":"Ghiasi, G., Lin, T.Y., and Le, Q.V. (2018). DropBlock: A regularization method for convolutional networks. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_41","unstructured":"Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (arXiv, 2014). Striving for simplicity: The all convolutional net, arXiv."},{"key":"ref_42","unstructured":"(2019, January 01). Pytorch. Available online: https:\/\/pytorch.org\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R.B., He, K., Hariharan, B., and Belongie, S.J. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/4\/430\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:33:17Z","timestamp":1760185997000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/4\/430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,19]]},"references-count":43,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["rs11040430"],"URL":"https:\/\/doi.org\/10.3390\/rs11040430","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,19]]}}}