MyMedR

Displaying all 3 publications

Abstract:

Sort:

Fulltext A Comprehensive Survey of Image-Based Food Recognition and Volume Estimation Methods for Dietary Assessment

Tahir GA, Loo CK

Healthcare (Basel), 2021 Dec 03;9(12).
PMID: 34946400 DOI: 10.3390/healthcare9121676

Dietary studies showed that dietary problems such as obesity are associated with other chronic diseases, including hypertension, irregular blood sugar levels, and increased risk of heart attacks. The primary cause of these problems is poor lifestyle choices and unhealthy dietary habits, which are manageable using interactive mHealth apps. However, traditional dietary monitoring systems using manual food logging suffer from imprecision, underreporting, time consumption, and low adherence. Recent dietary monitoring systems tackle these challenges by automatic assessment of dietary intake through machine learning methods. This survey discusses the best-performing methodologies that have been developed so far for automatic food recognition and volume estimation. Firstly, the paper presented the rationale of visual-based methods for food recognition. Then, the core of the study is the presentation, discussion, and evaluation of these methods based on popular food image databases. In this context, this study discusses the mobile applications that are implementing these methods for automatic food logging. Our findings indicate that around 66.7% of surveyed studies use visual features from deep neural networks for food recognition. Similarly, all surveyed studies employed a variant of convolutional neural networks (CNN) for ingredient recognition due to recent research interest. Finally, this survey ends with a discussion of potential applications of food image analysis, existing research gaps, and open issues of this research area. Learning from unlabeled image datasets in an unsupervised manner, catastrophic forgetting during continual learning, and improving model transparency using explainable AI are potential areas of interest for future studies.
Explainable deep learning ensemble for food image analysis on edge devices

Tahir GA, Loo CK

Comput Biol Med, 2021 12;139:104972.
PMID: 34749093 DOI: 10.1016/j.compbiomed.2021.104972

Food recognition systems recently garnered much research attention in the relevant field due to their ability to obtain objective measurements for dietary intake. This feature contributes to the management of various chronic conditions. Challenges such as inter and intraclass variations alongside the practical applications of smart glasses, wearable cameras, and mobile devices require resource-efficient food recognition models with high classification performance. Furthermore, explainable AI is also crucial in health-related domains as it characterizes model performance, enhancing its transparency and objectivity. Our proposed architecture attempts to address these challenges by drawing on the strengths of the transfer learning technique upon initializing MobiletNetV3 with weights from a pre-trained model of ImageNet. The MobileNetV3 achieves superior performance using the squeeze and excitation strategy, providing unequal weight to different input channels and contrasting equal weights in other variants. Despite being fast and efficient, there is a high possibility for it to be stuck in the local optima like other deep neural networks, reducing the desired classification performance of the model. Thus, we overcome this issue by applying the snapshot ensemble approach as it enables the M model in a single training process without any increase in the required training time. As a result, each snapshot in the ensemble visits different local minima before converging to the final solution which enhances recognition performance. On overcoming the challenge of explainability, we argue that explanations cannot be monolithic, since each stakeholder perceive the results', explanations based on different objectives and aims. Thus, we proposed a user-centered explainable artificial intelligence (AI) framework to increase the trust of the involved parties by inferencing and rationalizing the results according to needs and user profile. Our framework is comprehensive in terms of a dietary assessment app as it detects Food/Non-Food, food categories, and ingredients. Experimental results on the standard food benchmarks and newly contributed Malaysian food dataset for ingredient detection demonstrated superior performance on an integrated set of measures over other methodologies.
Fulltext MyDietCam: Development and usability study of a food recognition integrated dietary monitoring smartphone application

Kong NA, Moy FM, Ong SH, Tahir GA, Loo CK

Digit Health, 2023;9:20552076221149320.
PMID: 36644664 DOI: 10.1177/20552076221149320

BACKGROUND: Diet monitoring has been linked with improved eating habits and positive health outcomes such as prevention of obesity. However, this is often unsustainable as traditional methods place a high burden on both participants and researchers through pen and paper recordings and manual nutrient coding respectively. The digitisation of dietary monitoring has greatly reduced these barriers. This paper proposes a diet application with a novel food recognition feature with a usability study conducted in the real world.
METHODS: This study describes the development of a mobile diet application (MyDietCam) targeted at healthy Malaysian adults. Focus group discussions (FGD) were carried out among dietitians and potential users to determine ideal features in a diet application. Thirty participants were recruited from a local university to log their meals through MyDietCam for six days and submit the Malay mHealth Application Usability Questionnaire (M-MAUQ) at the end of the study.
RESULTS: The findings from the FGD led to the implementation of the main features: individualised recommendations, food logging through food recognition to reduce steps for data entry and provide detailed nutrient analyses through visuals. An average overall usability score of 5.13 out of a maximum of seven was reported from the M-MAUQ which is considered acceptable.
CONCLUSION: The development of a local (Malaysian) mobile diet application with acceptable usability may be helpful in sustaining the diet monitoring habit to improve health outcomes. Future work should focus on improving the issues raised before testing the effectiveness of the application for improving health outcomes.

Filters

Please provide feedback to Administrator ([email protected])

External Links