Pubfacts - Scientific Publication Data
  • Categories
  • |
  • Journals
  • |
  • Authors
  • Login
  • Categories
  • Journals

Search Our Scientific Publications & Authors

Publications
  • Publications
  • Authors
find publications by category +
Translate page:

Scene-graph-driven semantic feature matching for monocular digestive endoscopy.

Authors:
Zhuoyue Yang Junjun Pan Ranyang Li Hong Qin

Comput Biol Med 2022 Jul 16;146:105616. Epub 2022 May 16.

Department of Computer Science, Stony Brook University, New York, USA.

Background And Objective: Registration of the preoperative 3D model with the video of the digestive tract is the key task in endoscopy surgical navigation. Accurate 3D reconstruction of soft tissue surfaces is essential to complete registration. However, existing feature matching methods still fall short of desirable performance, due to the soft tissue deformation and smooth but less-textured surface.

Methods: In this paper, we present a new semantic description based on the scene graph to integrate contour features and SIFT features. Firstly, we construct the semantic feature descriptor using the SIFT features and dense points in the contour regions to obtain more dense point feature matching. Secondly, we design a clustering algorithm based on the proposed semantic feature descriptor. Finally, we apply the semantic description to the structure from motion (SfM) reconstruction framework.

Results: Our techniques are validated by the phantom tests and real surgery videos. We compare our approaches with other typical methods in contour extraction, feature matching, and SfM reconstruction. On average, the feature matching accuracy reaches 75.6% and improves 16.6% in pose estimation. In addition, 39.8% of sparse points are increased in SfM results, and 35.31% more valid points are obtained for the DenseDescriptorNet training in 3D reconstruction.

Conclusions: The new semantic feature description has the potential to reveal more accurate and dense feature correspondence and provides local semantic information in feature matching. Our experiments on the clinical dataset demonstrate the effectiveness and robustness of the novel approach.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.compbiomed.2022.105616DOI Listing
July 2022

Publication Analysis

Top Keywords

feature matching
24
semantic feature
20
feature
10
sift features
8
semantic description
8
soft tissue
8
feature descriptor
8
sfm reconstruction
8
matching
6
semantic
6
description structure
4
structure motion
4
motion sfm
4
reconstruction frameworkresults
4
frameworkresults techniques
4
techniques validated
4
tests real
4
validated phantom
4
phantom tests
4
finally apply
4

Keyword Occurance

Similar Publications

Global optimization point-set registration based on translation/rotation decoupling for image-guided surgery applications.

Authors:
Kexue Fu Xinrong Chen Manning Wang

Med Phys 2022 Jun 30. Epub 2022 Jun 30.

Digital Medical Research Center of School of Basic Medical Sciences, Fudan University, China.

Purpose: In image-guided surgery systems, image-to-patient spatial registration is to get the spatial transformation between the image space and the actual operating space. Although the image-to-patient spatial registration methods using paired-point or surface-matching are used in some image-guided neurosurgery systems, the key problem is that the global optimization registration result cannot be achieved. Therefore, this paper proposes a new rotation invariant feature for decoupling rotation and translation space, based on which global optimization point set registration method is proposed. Read More

View Article and Full-Text PDF
June 2022
Similar Publications

Computed Tomography Image Analysis of Body Fat Based on Multi-Image Information.

Authors:
Wei Zang Fengrui Zhu Yang Yu

Biomed Res Int 2022 20;2022:8265211. Epub 2022 Jun 20.

Department of Radiology, Shengjing Hospital of China Medical University, Shenyang 110004, China.

Body fat assessment is required as part of an objective health assessment, both for nonobese and obese people. Image-based body fat assessment will enable faster diagnosis. Body fat analysis that accounts for age and sex will help in both diagnosis and correlating diseases and fat distribution. Read More

View Article and Full-Text PDF
July 2022
Similar Publications

Music Emotion Classification Method Based on Deep Learning and Improved Attention Mechanism.

Authors:
Xiaoguang Jia

Comput Intell Neurosci 2022 20;2022:5181899. Epub 2022 Jun 20.

School of Music, Baotou Teacheis' College, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia 014030, China.

Since the existing music emotion classification researches focus on the single-modal analysis of audio or lyrics, the correlation among models are neglected, which lead to partial information loss. Therefore, a music emotion classification method based on deep learning and improved attention mechanism is proposed. First, the music lyrics features are extracted by Term Frequency-Inverse Document Frequency (TF-IDF) and Word2vec method, and the term frequency weight vector and word vector are obtained. Read More

View Article and Full-Text PDF
July 2022
Similar Publications

Cross Task Modality Alignment Network for Sketch Face Recognition.

Authors:
Yanan Guo Lin Cao Kangning Du

Front Neurorobot 2022 10;16:823484. Epub 2022 Jun 10.

Key Laboratory of Information and Communication Systems, Ministry of Information Industry, Beijing Information Science and Technology University, Beijing, China.

The task of sketch face recognition refers to matching cross-modality facial images from sketch to photo, which is widely applied in the criminal investigation area. Existing works aim to bridge the cross-modality gap by inter-modality feature alignment approaches, however, the small sample problem has received much less attention, resulting in limited performance. In this paper, an effective Cross Task Modality Alignment Network (CTMAN) is proposed for sketch face recognition. Read More

View Article and Full-Text PDF
June 2022
Similar Publications

Aortic valve calcification predicts poor outcomes after primary percutaneous coronary intervention.

Authors:
Chunfeng Dai Muyin Liu You Zhou Danbo Lu Zhangwei Chen Juying Qian Junbo Ge

Eur J Clin Invest 2022 Jun 24:e13828. Epub 2022 Jun 24.

Department of Cardiology, Shanghai Institute of Cardiovascular Diseases, Zhongshan Hospital, Fudan University, Shanghai, China.

Background: Aortic valve calcification (AVC) is associated with increased cardiovascular risk in the general population. We sought to investigate whether AVC identified by transthoracic echocardiography could be a predictor of long-term adverse events after primary percutaneous coronary intervention (PCI) in patients with acute myocardial infarction.

Methods: Patients undergoing primary PCI were consecutively enrolled in this cohort study between January 1, 2009 and December 31, 2018. Read More

View Article and Full-Text PDF
June 2022
Similar Publications
}
© 2022 PubFacts.
  • About PubFacts
  • Privacy Policy
  • Sitemap