https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&feed=atom&action=history Using GSEA v3.0 Features - Revision history 2024-03-28T20:14:37Z Revision history for this page on the wiki MediaWiki 1.34.4 https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&diff=4197&oldid=prev Eby at 03:18, 2 July 2017 2017-07-02T03:18:38Z <p></p> <a href="https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&amp;diff=4197&amp;oldid=4194">Show changes</a> Eby https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&diff=4194&oldid=prev Eby: moved Using GSEA v3.0 Beta Features to Using GSEA v3.0 Features 2017-07-02T02:19:40Z <p>moved <a href="/cancer/software/gsea/wiki/index.php/Using_GSEA_v3.0_Beta_Features" class="mw-redirect" title="Using GSEA v3.0 Beta Features">Using GSEA v3.0 Beta Features</a> to <a href="/cancer/software/gsea/wiki/index.php/Using_GSEA_v3.0_Features" title="Using GSEA v3.0 Features">Using GSEA v3.0 Features</a></p> <table class="diff diff-contentalign-left" data-mw="interface"> <tr class="diff-title" lang="en"> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="1" style="background-color: #fff; color: #222; text-align: center;">Revision as of 02:19, 2 July 2017</td> </tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div> </td></tr></table> Eby https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&diff=4141&oldid=prev Eby at 03:13, 24 October 2016 2016-10-24T03:13:03Z <p></p> <table class="diff diff-contentalign-left" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 03:13, 24 October 2016</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l41" >Line 41:</td> <td colspan="2" class="diff-lineno">Line 41:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;li&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;li&gt;</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>We recommend running your analyses with this setting disabled and using the PNGs to review your results.  When you have a satisfactory analysis run, you can reproduce the results by re-running the analysis with the same random seed setting as described above.  We recognize that this is not a convenient workflow, but changing the report generator to allow on-demand SVG generation was not feasible.  We may revisit this in the future if circumstances permit, but in the meantime this feature at least provides a means of producing higher-resolution images.</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>We recommend running your analyses with this setting disabled and using the PNGs to review your results.  When you have a satisfactory analysis run, you can reproduce the results by re-running the analysis with the same random seed setting as described above.  We recognize that this is not a convenient workflow, but changing the report generator to allow on-demand SVG generation was not feasible.  We may revisit this in the future if circumstances permit, but in the meantime this feature at least provides a means of producing higher-resolution images.</div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/ul&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;h1&gt;Override of GENE_SYMBOL.chip File Download&lt;/h1&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;ul&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">The GSEA Desktop makes use of a special CHIP file during the Collapse Dataset and Report generation steps.  In Desktop v2.2.x, this file is downloaded anew from the Broad FTP site in each session and held in memory only until the program exits.  This leads to possible failures for machines that are not connected to the Internet during an analysis run, which is common as these are often-used features.  Moreover, it means that the program repeatedly downloads this fixed-content file even though it has not changed in many years.  For use at the command-line or via the GenePattern modules, this means a file transfer on every analysis.</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">This Beta introduces an override mechanism to reuse a downloaded file and also avoid errors when running without a connection.  This is used by launching the Desktop with the 'GENE_SYMBOL_OVERRIDE' property set to 'true' and with the [ftp://ftp.broadinstitute.org/pub/gsea/annotations/GENE_SYMBOL.chip GENE_SYMBOL.chip] from our FTP site saved into the 'gsea_home' sub-directory of the users home directory (generally C:\users\&lt;username&gt;\gsea_home on Windows or /Users/&lt;username&gt;/gsea_home on a Mac).  You can open this from within GSEA using &lt;i&gt;Help &gt; Show GSEA home folder&lt;/i&gt;.</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">This requires [http://www.broadinstitute.org/gsea/doc/GSEAUserGuideFrame.html?Running_Command_Line running the GSEA Desktop from the command line].  To set this property, use 'java -DGENE_SYMBOL_OVERRIDE=true ...' in addition to the other Java flags and parameters.  Alternatively, a path can be provided instead so that the file can be stored elsewhere, e.g. '-DGENE_SYMBOL_OVERRIDE=/my/path/to/GENE_SYMBOL.chip'.  The file &lt;b&gt;must&lt;/b&gt; retain the GENE_SYMBOL.chip name in either case.</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;b&gt;This is an experimental feature for now&lt;/b&gt;.  A future Beta may enable it by default, removing the need to launch from the command line.  A future release of the GenePattern modules may include a similar dedicated override.</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;/li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">&lt;li&gt;</ins></div></td></tr> <tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">Note that the GENE_SYMBOL.chip has a special use within the GSEA code and should generally not be used directly for a Collapse Dataset call.</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/li&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/li&gt;</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/ul&gt;</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>&lt;/ul&gt;</div></td></tr> </table> Eby https://software.broadinstitute.org/cancer/software/gsea/wiki/index.php?title=Using_GSEA_v3.0_Features&diff=4139&oldid=prev Eby: Created page with '[http://www.broadinstitute.org/gsea/ GSEA Home] | [http://www.broadinstitute.org/gsea/downloads.jsp Downloads] | [http://www.broadinstitute.org/gsea/msigdb/ Molecular Signatures…' 2016-10-21T07:12:25Z <p>Created page with &#039;[http://www.broadinstitute.org/gsea/ GSEA Home] | [http://www.broadinstitute.org/gsea/downloads.jsp Downloads] | [http://www.broadinstitute.org/gsea/msigdb/ Molecular Signatures…&#039;</p> <p><b>New page</b></p><div>[http://www.broadinstitute.org/gsea/ GSEA Home] |<br /> [http://www.broadinstitute.org/gsea/downloads.jsp Downloads] | <br /> [http://www.broadinstitute.org/gsea/msigdb/ Molecular Signatures Database] | <br /> [http://www.broadinstitute.org/cancer/software/gsea/wiki/index.php/Main_Page Documentation] |<br /> [http://www.broadinstitute.org/gsea/contact.jsp Contact]&lt;br /&gt;<br /> <br /> &lt;p&gt;<br /> This page is meant as a brief introduction and guide to using some of the new features in the GSEA v3.0 Beta series. The information will eventually go into our official documentation, but will reside here until then.<br /> &lt;/p&gt;<br /> <br /> &lt;h1&gt;Re-running Analyses and Verifying GSEA v3.0 Results with GSEA v2.2.x&lt;/h1&gt;<br /> &lt;ul&gt;<br /> &lt;li&gt;<br /> Our tests show the v3.0 Beta produces equivalent results, but use the Production version if you have concerns. At a minimum, verification with the Production version before publication is strongly recommended.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> Cross-verifying with the Production version allows you to use the Beta features with confidence that the results are not affected by any changes in the Beta code. To do this, you can re-run your v3.0 analysis in v2.2.x using the equivalent parameter settings. <br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> While there are a few new v3.0 parameters, these mostly provide additional control over the result files. Nearly all of the parameters required for analysis are present in both versions (the exception being &lt;i&gt;alternate delimiter&lt;/i&gt;, see below). After re-running the analysis, compare the output files and plots from the runs between the two versions. Our testing has shown these to be identical (though see the note on &lt;i&gt;SVG&lt;/i&gt; output below).<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> If you have provided a specific random seed value in your Beta analysis simply carry this value over to the Production analysis settings under 'Advanced fields'. In GSEA v2.2.x and earlier, if you used the &lt;i&gt;timestamp&lt;/i&gt; setting there was no way to obtain the actual numeric value used in the random number generator, meaning that it was not possible to reliably reproduce the exact analysis output. A new feature has been implemented in the Beta to save this timestamp value into the 'Comments' section of the main page of the HTML Report. By setting this value for the random seed in your GSEA v2.2.x analysis you can reproduce your v3.0 results.<br /> &lt;/li&gt;<br /> &lt;/ul&gt;<br /> <br /> &lt;h1&gt;Generating SVG Plots&lt;/h1&gt;<br /> &lt;ul&gt;<br /> &lt;li&gt;<br /> We have occasionally received requests for a feature to generate plots in a higher-resolution than is possible with the PNG format. To meet this need, the Beta offers a new &lt;i&gt;Create SVG plot images&lt;/i&gt; analysis setting in the 'Advanced fields' section.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> This setting is turned off by default as these plots are somewhat CPU-intensive to produce and they can be substantially larger than the corresponding PNGs, e.g. &lt;b&gt;~150x&lt;/b&gt; the size in the case of our Enrichment Plots. The generated files are GZ compressed for the same reason. They compress quite well but can still be up to ~5x the size of the corresponding PNGs. They can be decompressed using 'gunzip' on Mac or Linux and 7-Zip on Windows.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> The SVG plots should be viewable in most modern web browsers and editable in a variety of software such as Inkscape or Adobe Illustrator; we have no particular recommendations.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> Note that the SVG plots may match &lt;i&gt;closely but not exactly&lt;/i&gt; to the PNGs. The fonts in particular may be slightly different.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> We recommend running your analyses with this setting disabled and using the PNGs to review your results. When you have a satisfactory analysis run, you can reproduce the results by re-running the analysis with the same random seed setting as described above. We recognize that this is not a convenient workflow, but changing the report generator to allow on-demand SVG generation was not feasible. We may revisit this in the future if circumstances permit, but in the meantime this feature at least provides a means of producing higher-resolution images.<br /> &lt;/li&gt;<br /> &lt;/ul&gt;<br /> <br /> &lt;h1&gt;Extracting the Heatmap Datasets&lt;/h1&gt;<br /> &lt;ul&gt;<br /> &lt;li&gt;<br /> We have occasionally received requests for more control over the generated heatmap images, such as reordering/clustering rows &amp; columns, changing the color scheme, adding a scale, etc. While these are all very worthwhile, at this time it is not feasible for us to alter GSEA's report generation and plotting code in the significant ways that would be required to accomplish this. While we may revisit this in the future if circumstances permit, the Beta has a new feature that gives an alternate path for users to accomplish this on their own. Some users have also asked for access to the underlying dataset represented by these heatmaps. To satisfy both of these needs, the Beta now offers a new &lt;i&gt;Create GCT Files&lt;/i&gt; setting under 'Advanced fields' which will save the datasets backing each of the heatmaps in the report, allowing their use in external visualizers or analysis tools.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> A GCT file will be created for each heatmap plot; the file names will match except for the '.gct' extension. This is GSEA's standard data matrix format and it can be readily used in R, [http://www.genepattern.org GenePattern], [https://software.broadinstitute.org/morpheus/ Morpheus], or [https://software.broadinstitute.org/GENE-E/ GENE-E] among other options. See our [[Data formats]] page for details.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> You may wish to use the corresponding CLS file to identify phenotype classes to this external software. This file is available as part of the saved report in the 'edb' subdirectory.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> A common user question is &lt;b&gt;What is the source of this data?&lt;/b&gt; Fortunately, the answer is quite simple: the data comes directly from the input dataset (GCT, RES, PCL, etc). It is your original expression data, just reordered to match the limited set of genes represented in the given heatmap (though possibly &quot;collapsed&quot; to map probe-level data to the corresponding genes). You may thus find these GCTs useful for further downstream analysis of a subset of your data in the context of an individual Gene Set, for example.<br /> &lt;/li&gt;<br /> &lt;/ul&gt;<br /> <br /> &lt;h1&gt;Working with C3 MIR datasets using the &lt;i&gt;alternate delimiter&lt;/i&gt; setting&lt;/h1&gt;<br /> &lt;ul&gt;<br /> &lt;li&gt;<br /> In general we recommend that Gene Set and input file names should stick to alphanumeric characters, plus the underscore as a separator. Use of other 'special' characters can cause issues on some operating systems and programming languages, and those issues may vary across Mac, Linux, and Windows.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> The C3 MIR sub-collection did not keep to this advice. It used the comma character as part of the Gene Set name, which conflicts with the separator character GSEA v2.2.3 uses for the Gene Set selector fields. Use of this field to select MIR Gene Sets would thus fail as GSEA could not distinguish between the commas &lt;i&gt;within the names&lt;/i&gt; and the commas &lt;i&gt;separating the names&lt;/i&gt;. Unfortunately, renaming these Gene Sets is difficult as this sub-collection has been in use for a long time.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> GSEA v3.0 Beta introduces a new &lt;i&gt;alternate delimiter&lt;/i&gt; setting in 'Advanced fields' to allow you to override the default separator for cases like this. We recommend using the semicolon ';' instead.<br /> &lt;/li&gt;<br /> &lt;li&gt;<br /> Regardless of the situation with the C3 MIR sub-collection names, we encourage you to avoid these characters in your own Gene Set and file names.<br /> &lt;/li&gt;<br /> &lt;/ul&gt;</div> Eby