BrainX Waves: The Newsletter of BrainX Community

December 2024: Issue 6

Dec 30, 2024

Happy Holidays and Happy New Year!

Learn

2024 was the year of strategies. After the release of multiple LLMs and frameworks last year, the key focus for 2024 was on developing strategies for their adoption. Many of the strategic guidance were focused on educating ourselves about the technical needs and the value proposition, and many others on evaluation and implementation. Below are some of the key BrainXAI ReSearch publications and more focused on these strategies from this year. 2025 is likely to focus on evaluation of the concepts, the experiments and the solutions we developed for adoption of AI in healthcare.

Navigating AI: A Quick Start Guide for Healthcare Professionals

Strategies for Artificial Intelligence in Healthcare: Real-World Solutions for Reshaping Healthcare Through Artificial Intelligence and Beyond

Strategic and Value-based Implementation of Generative AI in Healthcare

A framework for human evaluation of large language models in healthcare derived from literature review

Learn More

Connect

BrainX Community Live! December 2024: Foundation models in Cardiology – Automating Echocardiography with Echoprime.

The BrainX Community Live event featured a presentation on AI for comprehensive transthoracic echocardiogram exam interpretation, showcasing the EchoPrime model's capabilities in automating echocardiography analysis and report generation.

EchoPrime, a multi-view, view-informed, video-based vision-language foundation model trained on over 12 million video-report pairs. The presenters discussed the model's technical aspects, training process, and performance, highlighting its potential to improve healthcare outcomes and democratize access to medical expertise.

The model was trained on 2 Nvidia Rtx A 6,000 Gpus with a batch size of 32. The training took approximately one month. The model was trained to analyze echocardiograms and use synthesized information across the whole study. The results showed that as more data was included, the accuracy progressively improved. EchoPrime outperformed previous models on all tasks, particularly those requiring temporal information.

The presenters also compared EchoPrime with task-specific models and found that EchoPrime either outperformed or matched their performance. The event concluded with discussions on the future directions of AI in healthcare, including the integration of more medical modalities and the importance of collaboration between clinicians and engineers in model development and validation.

Presenters: Milos Vukadnovic, PhD Candidate at UCLA; I-Min Chiu, MD, PhD

Related publication: EchoPrime: A Multi-Video View-Informed Vision-Language Model for Comprehensive Echocardiography Interpretation. Milos Vukadinovic, Xiu Tang, Neal Yuan, Paul Cheng, Debiao Li, Susan Cheng, Bryan He, David Ouyang.

Join our January 2025, BrainX Community Live event on Evaluating Large Language Models with frameworks and tools for healthcare

Registration Link: https://us02web.zoom.us/meeting/register/n79nZz6xTZOIqaISs9qDSA

Program agenda: Panel discussion on tools and frameworks for LLM evaluations in healthcare.

Featured panelists:

- Dr. Ashish Atreja, UC Davis; VALIDAI

- Dr. Yanshan Wang, University of Pittsburgh

Moderator: Dr. Piyush Mathur, Cleveland Clinic; BrainX

Connect More

Datasets

UniTox: drug-induced toxicity dataset

A unified dataset of 2,418 FDA-approved drugs with drug-induced toxicity summaries and ratings created by using GPT-4o to process FDA drug labels. UniTox spans eight types of toxicity: cardiotoxicity, liver toxicity, renal toxicity, pulmonary toxicity, hematological toxicity, dermatological toxicity, ototoxicity, and infertility.

MedConceptsQA

An open source benchmark for medical concepts question answering. The benchmark comprises questions of various medical concepts across different vocabularies: diagnoses, procedures, and drugs. The questions are categorized into three levels of difficulty: easy, medium, and hard.

More Data

Podcast

In this episode, we feature Dr. Amol M. Joshi. Dr. Joshi is the Thomas H. Davis Professor in Business at Wake Forest University (WFU). He holds a joint faculty appointment as an Associate Professor of Strategic Management in the WFU School of Business and as an Associate Professor of Innovation & Commercialization in the WFU School of Medicine.

Dr. Joshi is an inventor who helps others reinvent themselves. His passion is guiding aspiring entrepreneurs, executives, and students of all levels to pursue their business dreams. He has trained startup founders, corporate managers, and industry leaders in the US, Austria, Denmark, and Vietnam.

A recognized expert on innovation, his interdisciplinary research examines how inventors create and commercialize new technologies and launch and fund new ventures. With a 13-year prior career as an engineer and entrepreneur in venture capital-funded startups in Silicon Valley, Dr. Joshi co-invented two patents for AI-based voice assistant products. He co-founded BeVocal, a speech recognition software startup acquired by Nuance Communications, and served as VP of Sales & Marketing from 1999 to 2003.

Dr. Joshi has advised Federal agencies including NASA, NSF, NIH, and the US Department of Energy on national innovation policies and R&D grant programs for small businesses. Dr. Joshi earned a PhD in Business Administration from UNC Chapel Hill, an MBA and MS in Engineering Sciences from Dartmouth College, and a BS in Electrical Engineering from Georgia Tech with highest honors.

Listen More

Conferences

The Doctors AI Global Summit on AI in Healthcare, held virtually on December 14 and 15, 2024, was a landmark event that brought together over 1,000 attendees from around the globe. The summit featured in-depth discussions on the transformative role of artificial intelligence in healthcare through 8 keynote addresses, 14 plenary sessions, and 8 panel discussions. More than 100 esteemed faculty members and 30 international experts across various specialties contributed to rich dialogues on a range of topics, from AI-driven patient care to responsible AI innovations.

Keynote presentations explored critical issues such as the current state and future directions of AI in healthcare, ethical considerations in AI-driven healthcare, and the potential and challenges of validating and deploying Large Language Models (LLMs) effectively within medical contexts. The summit also highlighted the integration of AI in various medical subspecialties, public health transformation, AI education for medical professionals, and revolutionary changes AI is bringing to drug discovery and development.

A notable panel on AI ethics emphasized the importance of maintaining ethical standards in the deployment of AI technologies in healthcare settings. The event also showcased an oral presentation competition that spotlighted cutting-edge research, including predictive AI models for surgical outcomes. Overall, the summit emphasized AI’s role in enhancing healthcare delivery, fostering ethical innovation, and improving patient outcomes, marking a significant advancement in the global healthcare landscape.