Search Results for author: Nicholas J. Durr

Found 18 papers, 6 papers with code

Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registration

no code implementations17 Jun 2022 Taylor L. Bobrow, Mayank Golhar, Rohan Vijayan, Venkata S. Akshintala, Juan R. Garcia, Nicholas J. Durr

In this work, we present a Colonoscopy 3D Video Dataset (C3VD) acquired with a high definition clinical colonoscope and high-fidelity colon models for benchmarking computer vision methods in colonoscopy.

Benchmarking Depth Estimation +4

GAN Inversion for Data Augmentation to Improve Colonoscopy Lesion Classification

no code implementations4 May 2022 Mayank Golhar, Taylor L. Bobrow, Saowanee Ngamruengphong, Nicholas J. Durr

This study demonstrates that synthetic colonoscopy images generated by Generative Adversarial Network (GAN) inversion can be used as training data to improve the lesion classification performance of deep learning models.

Classification Data Augmentation +3

A Deep Learning Bidirectional Temporal Tracking Algorithm for Automated Blood Cell Counting from Non-invasive Capillaroscopy Videos

2 code implementations26 Nov 2020 Luojie Huang, Gregory N. McKay, Nicholas J. Durr

Compared to manual blood cell counting, CycleTrack achieves 96. 58 $\pm$ 2. 43% cell counting accuracy among 8 test videos with 1000 frames each compared to 93. 45% and 77. 02% accuracy for independent CenterTrack and SORT almost without additional time expense.

Cell Tracking Multiple Object Tracking

Improving colonoscopy lesion classification using semi-supervised deep learning

no code implementations7 Sep 2020 Mayank Golhar, Taylor L. Bobrow, MirMilad Pourmousavi Khoshknab, Simran Jit, Saowanee Ngamruengphong, Nicholas J. Durr

While data-driven approaches excel at many image analysis tasks, the performance of these approaches is often limited by a shortage of annotated data available for training.

Classification Domain Adaptation +3

VR-Caps: A Virtual Environment for Capsule Endoscopy

2 code implementations29 Aug 2020 Kagan Incetan, Ibrahim Omer Celik, Abdulhamid Obeid, Guliz Irem Gokceler, Kutsev Bengisu Ozyoruk, Yasin Almalioglu, Richard J. Chen, Faisal Mahmood, Hunter Gilbert, Nicholas J. Durr, Mehmet Turan

Current capsule endoscopes and next-generation robotic capsules for diagnosis and treatment of gastrointestinal diseases are complex cyber-physical platforms that must orchestrate complex software and hardware functions.

Depth Estimation Visual Localization

Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning

no code implementations1 Jul 2020 Mason T. Chen, Nicholas J. Durr

When tested on human feet, a cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96. 5%.

EndoL2H: Deep Super-Resolution for Capsule Endoscopy

3 code implementations13 Feb 2020 Yasin Almalioglu, Kutsev Bengisu Ozyoruk, Abdulkadir Gokce, Kagan Incetan, Guliz Irem Gokceler, Muhammed Ali Simsek, Kivanc Ararat, Richard J. Chen, Nicholas J. Durr, Faisal Mahmood, Mehmet Turan

Although wireless capsule endoscopy is the preferred modality for diagnosis and assessment of small bowel diseases, the poor camera resolution is a substantial limitation for both subjective and automated diagnostics.

Super-Resolution

SLAM Endoscopy enhanced by adversarial depth prediction

no code implementations29 Jun 2019 Richard J. Chen, Taylor L. Bobrow, Thomas Athey, Faisal Mahmood, Nicholas J. Durr

Medical endoscopy remains a challenging application for simultaneous localization and mapping (SLAM) due to the sparsity of image features and size constraints that prevent direct depth-sensing.

Depth Prediction Monocular Depth Estimation +1

GANPOP: Generative Adversarial Network Prediction of Optical Properties from Single Snapshot Wide-field Images

no code implementations12 Jun 2019 Mason T. Chen, Faisal Mahmood, Jordan A. Sweer, Nicholas J. Durr

In human gastrointestinal specimens, GANPOP estimates both reduced scattering and absorption coefficients at 660 nm from a single 0. 2/mm spatial frequency illumination image with 58% higher accuracy than SSOP.

Generative Adversarial Network

Structured Prediction using cGANs with Fusion Discriminator

no code implementations ICLR 2019 Faisal Mahmood, Wenhao Xu, Nicholas J. Durr, Jeremiah W. Johnson, Alan Yuille

We propose the fusion discriminator, a single unified framework for incorporating conditional information into a generative adversarial network (GAN) for a variety of distinct structured prediction tasks, including image synthesis, semantic segmentation, and depth estimation.

Depth Estimation Generative Adversarial Network +3

Multimodal Densenet

no code implementations18 Nov 2018 Faisal Mahmood, Ziyun Yang, Thomas Ashley, Nicholas J. Durr

In this work, we propose Multimodal DenseNet, a novel architecture for fusing multimodal data.

DeepLSR: a deep learning approach for laser speckle reduction

2 code implementations23 Oct 2018 Taylor L. Bobrow, Faisal Mahmood, Miguel Inserni, Nicholas J. Durr

In images of gastrointestinal tissues, DeepLSR reduces laser speckle noise by 6. 4 dB, compared to a 2. 9 dB reduction from optimized non-local means processing, a 3. 0 dB reduction from BM3D, and a 3. 7 dB reduction from an optical speckle reducer utilizing an oscillating diffuser.

Rethinking Monocular Depth Estimation with Adversarial Training

no code implementations22 Aug 2018 Richard Chen, Faisal Mahmood, Alan Yuille, Nicholas J. Durr

Most existing approaches treat depth estimation as a regression problem with a local pixel-wise loss function.

Monocular Depth Estimation

Deep Learning with Cinematic Rendering: Fine-Tuning Deep Neural Networks Using Photorealistic Medical Images

no code implementations22 May 2018 Faisal Mahmood, Richard Chen, Sandra Sudarsky, Daphne Yu, Nicholas J. Durr

Our experiments demonstrate that: (a) Convolutional Neural Networks (CNNs) trained on synthetic data and fine-tuned on photorealistic cinematically rendered data adapt better to real medical images and demonstrate more robust performance when compared to networks with no fine-tuning, (b) these fine-tuned networks require less training data to converge to an optimal solution, and (c) fine-tuning with data from a variety of photorealistic rendering conditions of the same scene prevents the network from learning patient-specific information and aids in generalizability of the model.

Monocular Depth Estimation

Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training

no code implementations17 Nov 2017 Faisal Mahmood, Richard Chen, Nicholas J. Durr

We propose an alternative framework that uses a reverse flow, where adversarial training is used to make real medical images more like synthetic images, and hypothesize that clinically-relevant features can be preserved via self-regularization.

Depth Estimation Domain Adaptation

Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopy

no code implementations30 Oct 2017 Faisal Mahmood, Nicholas J. Durr

We show that the estimated depth maps can be used for reconstructing the topography of the mucosa from conventional colonoscopy images.

Depth Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.