PredictMod User Guide: Difference between revisions

From HIVE Lab
Jump to navigation Jump to search
No edit summary
mNo edit summary
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
<h2>FAQ</h2>
<small> Go Back to [[PredictMod|PredictMod Project]]. </small>
<p>
<strong>How can I run a prediction using a single-patient data file?</strong><br/>
Use the query builder to select the desired condition, intervention, and data type associated with your patient data. File upload templates vary by model. Reference our example files to ensure your data meets our formatting requirements. Select ‘Run Prediction’ to view the results.<br/><br/>
For additional assistance with uploading and formatting data, please contact our team.<br/><br/>


<strong>Will the system store patient data?</strong><br/>
<h2>What is PredictMod?</h2>
The data will not be saved in the system. PredictMod will use uploaded patient data to make a one-time prediction.<br/><br/>
<p>The PredictMod platform utilizes machine learning tools and complex datasets based on electronic health records, gut microbiome, and -omics data to forecast patient outcomes, often in response to treatment for a particular condition. [[PredictMod|Learn more about the PredictMod Project]]</p>


<strong>What are the possible prediction outcomes?</strong><br/>
<h4>Additional Resources:</h4>
PredictMod will provide a prediction categorized as either <em>Responder</em> or <em>Non-Responder</em>. The outcomes associated with the response status vary for each model, though a <em>Responder</em> result is generally associated with a positive health outcome, and the <em>Non-Responder</em> result is generally associated with a negative health outcome.<br/><br/>
<ul>
For additional information, please review the model information below.<br/><br/>
    <li>[https://hivelab.biochemistry.gwu.edu/predictmod/ PredictMod Portal]</li>
    <li>[[Frequently Asked Questions]]</li>
    <li>[[PredictMod Contact Us|Contact Us]]</li>
</ul>


<strong>What data types are included in the PredictMod query selection?</strong><br/>
<h2>Login & Registration</h2>
The current data types are metagenomic (MG) and electronic health record (EHR). We also have a glycomics data type coming soon.<br/><br/>
<h3>How to register with PredictMod</h3>
<p>Individuals interested in creating a PredictMod account should do so through the [https://hivelab.biochemistry.gwu.edu/predictmod/login Login] page. If you have any questions, please contact us at ''mazumder_lab@gwu.edu''.</p>


<em>MG data</em> consist of the microbial composition of the gut microbiome typically displayed as a percent of abundance. This data is typically used within a research context to profile healthy gut microbiomes and to identify differential abundances and their associations to disease. Our MG Model is trained on publicly available data. The reference genomes used for this model are recorded in the Gut Feeling Knowledge Base (GFKB). Please use this list as a reference. Organisms not referenced in the GFKB can still be included in the input and receive an accurate model prediction. If you have any questions about this, please don’t hesitate to contact our team.<br/><br/>
== 'Try it Out' Example Query Builder ==
<h3>How the example query builder works</h3>
<p>The example query builder is distinct from the standard query builder in that only the example prediction file is accepted. You cannot upload your own single-patient files into the example query builder and obtain a prediction.</p>


<em>EHR</em> consists of real-time patient-centered records that are utilized by physicians to streamline their workflow. It provides physicians the ability to view important medical details about their patients in order to provide improved patient care that is both efficient and safe. Our EHR models are trained on data from the MDClone and Epic Cosmos.<br/><br/>
<p>You can build an example query by selecting the condition, intervention, and data type of interest to you. Based on these selections, an example data file will be available for download.</p>


<strong>What conditions are included in the PredictMod query selection?</strong><br/>
<p>You should use example data files as a template for your own data upload.</p>
The current condition of interest is Prediabetes. We also have an Epilepsy model coming soon.<br/><br/>


<em>Prediabetes</em> is a precursor to Type 2 Diabetes Mellitus (T2DM), where blood sugars are higher than normal, but not high enough to be considered T2DM. Prediction outcomes are based on a 5% reduction in weight, HOMA-IR, or a diagnosis of T2DM.<br/><br/>
<h3>Download example data</h3>
<p>Example data files for each model are provided in the query builder.</p>


<strong>What interventions are included in the PredictMod query selection?</strong><br/>
<h2>Current Models</h2>
The current interventions are exercise, ketogenic diet, and dietary counseling. We also have a Semaglutide intervention coming soon.
<p>Current and anticipated models are shown on the [https://hivelab.biochemistry.gwu.edu/predictmod/models Models] page.</p>
</p>
 
<h2>Query Builder</h2>
 
<h3>How the query builder works</h3>
<p>The query builder determines the appropriate model to use for a prediction, based on the desired condition, intervention, and data type. Please follow the prompts on the Query Builder page to make your selections. Descriptions of the conditions, interventions, and data types are documented within each Model's BioCompute Object (BCO). You will then be able to upload your own file or download an example file. The uploaded file must meet the formatting requirements associated with the chosen model. For information on formatting, please review the sample data, FAQs, or contact our team.</p>
 
<h3>Run a prediction</h3>
<p>Once a correctly formatted file has been uploaded, select ‘Run Prediction’ to view your results.</p>
 
<h3>Interpreting a prediction result</h3>
 
<h4>Responder vs. Non-Responder outcomes</h4>
<p>PredictMod will provide a prediction categorized as either Responder or Non-Responder. The outcomes associated with the response status vary for each model, though a Responder result is generally associated with a positive health outcome, and the Non-Responder result is generally associated with a negative health outcome.</p>
 
<h4>Data visualization examples and interpretations</h4>
<p>The primary data visualization tool is a SHAP force plot. Shapley Value originates from game theory and involves the fair distribution of reward based on the degree of contribution of each player. This can be utilized in precision medicine to identify the key “players” or features that contribute to a given prediction. The SHAP (SHapley Additive exPlanations) Force Plot leverages this ideology to provide Explainable AI with respect to the single-patient predictions made by PredictMod. Each plot for a given prediction not only indicates the most influential features but highlights whether that feature pushes the prediction higher (in red) or lower (in blue). The consideration of the features and their values leads to a score, where higher scores indicate a prediction of 1, or NR and lower scores a prediction of 0, or R. SHAP Force Plots also indicate the degree of feature impact based on proximity to the boundary line where the red and blue bars meet. The closer to the dividing boundary, the more impact that feature had on the patient’s prediction.</p>
 
<h3>Run another prediction</h3>
<p>Selecting 'Run Another Prediction' will return you to the query builder page, where you can complete steps 1 through 4 to run a new prediction. As a reminder, no patient data is stored in the PredictMod server, so running another prediction will erase any currently displayed results.</p>
 
<h2>Upload a Model</h2>
<p>PredictMod is a collaborative space for researchers to upload their intervention-based models and performance metrics. These models are freely available to users and commercial entities under the CC BY 4.0 license. While our current focus is Prediabetes, the platform allows for multiple models to overlap among conditions and interventions. Researchers can upload their model and relevant documentation directly to PredictMod to make it freely available to users.</p>
 
<br>

Latest revision as of 20:00, 12 March 2025

Go Back to PredictMod Project.

What is PredictMod?

The PredictMod platform utilizes machine learning tools and complex datasets based on electronic health records, gut microbiome, and -omics data to forecast patient outcomes, often in response to treatment for a particular condition. Learn more about the PredictMod Project

Additional Resources:

Login & Registration

How to register with PredictMod

Individuals interested in creating a PredictMod account should do so through the Login page. If you have any questions, please contact us at mazumder_lab@gwu.edu.

'Try it Out' Example Query Builder

How the example query builder works

The example query builder is distinct from the standard query builder in that only the example prediction file is accepted. You cannot upload your own single-patient files into the example query builder and obtain a prediction.

You can build an example query by selecting the condition, intervention, and data type of interest to you. Based on these selections, an example data file will be available for download.

You should use example data files as a template for your own data upload.

Download example data

Example data files for each model are provided in the query builder.

Current Models

Current and anticipated models are shown on the Models page.

Query Builder

How the query builder works

The query builder determines the appropriate model to use for a prediction, based on the desired condition, intervention, and data type. Please follow the prompts on the Query Builder page to make your selections. Descriptions of the conditions, interventions, and data types are documented within each Model's BioCompute Object (BCO). You will then be able to upload your own file or download an example file. The uploaded file must meet the formatting requirements associated with the chosen model. For information on formatting, please review the sample data, FAQs, or contact our team.

Run a prediction

Once a correctly formatted file has been uploaded, select ‘Run Prediction’ to view your results.

Interpreting a prediction result

Responder vs. Non-Responder outcomes

PredictMod will provide a prediction categorized as either Responder or Non-Responder. The outcomes associated with the response status vary for each model, though a Responder result is generally associated with a positive health outcome, and the Non-Responder result is generally associated with a negative health outcome.

Data visualization examples and interpretations

The primary data visualization tool is a SHAP force plot. Shapley Value originates from game theory and involves the fair distribution of reward based on the degree of contribution of each player. This can be utilized in precision medicine to identify the key “players” or features that contribute to a given prediction. The SHAP (SHapley Additive exPlanations) Force Plot leverages this ideology to provide Explainable AI with respect to the single-patient predictions made by PredictMod. Each plot for a given prediction not only indicates the most influential features but highlights whether that feature pushes the prediction higher (in red) or lower (in blue). The consideration of the features and their values leads to a score, where higher scores indicate a prediction of 1, or NR and lower scores a prediction of 0, or R. SHAP Force Plots also indicate the degree of feature impact based on proximity to the boundary line where the red and blue bars meet. The closer to the dividing boundary, the more impact that feature had on the patient’s prediction.

Run another prediction

Selecting 'Run Another Prediction' will return you to the query builder page, where you can complete steps 1 through 4 to run a new prediction. As a reminder, no patient data is stored in the PredictMod server, so running another prediction will erase any currently displayed results.

Upload a Model

PredictMod is a collaborative space for researchers to upload their intervention-based models and performance metrics. These models are freely available to users and commercial entities under the CC BY 4.0 license. While our current focus is Prediabetes, the platform allows for multiple models to overlap among conditions and interventions. Researchers can upload their model and relevant documentation directly to PredictMod to make it freely available to users.