Cloudy SolarSoftware

From RHESSI Wiki

(Difference between revisions)
Jump to: navigation, search
(rewrote introduction and moved some text to the next section. still rough.)
m (Introduction)
Line 18: Line 18:
In this nugget we would like to describe an important new tool that has been developed for the Solar physics community in collaboration with the Virtual Solar Observatory ([http://umbra.nascom.nasa.gov/vso/ VSO]).  Our goal is to provide an integrated analysis experience in IDL that is both easy-to-use for the casual observer or amateur but can also be used for detailed scientific analysis by more knowledgeable users.
In this nugget we would like to describe an important new tool that has been developed for the Solar physics community in collaboration with the Virtual Solar Observatory ([http://umbra.nascom.nasa.gov/vso/ VSO]).  Our goal is to provide an integrated analysis experience in IDL that is both easy-to-use for the casual observer or amateur but can also be used for detailed scientific analysis by more knowledgeable users.
-
The current mode of operation for solar data analysis begins with the retrieval of raw data from somewhere on the internet (i.e. the Cloud).  New tools such as the VSO are currently being developed to make this task easier as solar data is hosted on a multitude of websites.  After the data has been retrieved, the bulk of the work (the preperation, display, and analysis of the data) is performed locally on a user's desktop or laptop computer.  This mode of operation places a large burden on the user as it is then their responsibility to keep up to date with changes with all of the software necessary for each of these steps.  In order to alleviate this problem, we have developed a new extended analysis environment ([http://en.wikipedia.org/wiki/Cloud_computing Cloud Computing]), where IDL has access to services available on other computers through the Internet .  This environment can easily be accessed through the main menu in the RHESSI GUI or by simply typing the following command in IDL
+
The current mode of operation for solar data analysis begins with the retrieval of raw data from somewhere on the internet (i.e. the Cloud).  New tools such as the VSO are currently being developed to make this task easier as solar data is hosted on a multitude of websites.  After the data has been retrieved, the bulk of the work (the preperation, display, and analysis of the data) is performed locally on a user's desktop or laptop computer.  This mode of operation places a large burden on the user as it is then their responsibility to keep up to date with changes with all of the software necessary for each of these steps.  In order to alleviate this problem, we have developed a new extended analysis environment ([http://en.wikipedia.org/wiki/Cloud_computing Cloud Computing]), where IDL has access to services available on other computers through the Internet .  This environment can easily be accessed through the main menu in the RHESSI GUI or by simply typing "show_synop" on the IDL command line.
-
 
+
-
<code lang="ittvis_idl">
+
-
show_synop
+
-
</code>
+
== SHOW_SYNOP IDL Widget ==
== SHOW_SYNOP IDL Widget ==

Revision as of 23:32, 29 June 2010


Nugget
Number: XXXwarning.png"XXX" is not a number.
1st Author: Laszlo I. Etesi
2nd Author: Brian R. Dennis
Published: 2010 July 5
Next Nugget: TBD
Previous Nugget: TBD
List all



Contents

NOTE

This nugget is unfinished and still undergoing changes.

Introduction

In this nugget we would like to describe an important new tool that has been developed for the Solar physics community in collaboration with the Virtual Solar Observatory (VSO). Our goal is to provide an integrated analysis experience in IDL that is both easy-to-use for the casual observer or amateur but can also be used for detailed scientific analysis by more knowledgeable users.

The current mode of operation for solar data analysis begins with the retrieval of raw data from somewhere on the internet (i.e. the Cloud). New tools such as the VSO are currently being developed to make this task easier as solar data is hosted on a multitude of websites. After the data has been retrieved, the bulk of the work (the preperation, display, and analysis of the data) is performed locally on a user's desktop or laptop computer. This mode of operation places a large burden on the user as it is then their responsibility to keep up to date with changes with all of the software necessary for each of these steps. In order to alleviate this problem, we have developed a new extended analysis environment (Cloud Computing), where IDL has access to services available on other computers through the Internet . This environment can easily be accessed through the main menu in the RHESSI GUI or by simply typing "show_synop" on the IDL command line.

SHOW_SYNOP IDL Widget

Before we begin, it is important to note the minimum requirements to run this software suite.

SHOW_SYNOP provides the starting point for solar data analysis, data file retrieval. SHOW_SYNOP provides an easy to use interface to the VSO directly in IDL and can download data either directly to the user's computer or through a pre-processing server (PrepServer) that provides remote execution of instrument-specific data preparation procedures. The raw and/or pre-processed data can then be displayed with our GUI plotting suite, PLOTMAN, which can handle different data types (light curves, images, and spectra), and perform basic data analysis. The workflow within this overall integrated environment is shown in Figures 1, 2, and 3, where the numbers correspond to steps 1-2-3 explained below in the text. Note that all of the operations can be controlled using either graphical user interfaces (GUIs) or through the IDL command line, or, and this is often the most efficient approach, through a combination of the two.

Our environment supports data from a growing number of solar instruments that currently includes RHESSI, SOHO/EIT, TRACE, SECCHI/EUVI, HINODE/XRT, and HINODE/EIS.

Step 1: Finding the Data

SHOW_SYNOP shown in Figure 4 is an IDL graphical user interface (GUI) to search for and retrieve instrument data within a specified time interval using the VSO or other data finding facilities.

Search results can be directly downloaded into the active SSW IDL environment or first pre-processed through our prep-server. To start searching with SHOW_SYNOP, first open the GUI by typing SHOW_SYNOP in your SSW IDL environment command-line. The red box highlights the VSO search form with "Start Time" and "End Time" specifying the search interval and "remote sites ->" defining the instrument (TRACE in this example). Click on the "Search" button to query the VSO for data files that will be displayed in the list below the search form shown in the green box in Figure 5. All of this capability can also be obtained by executing IDL scripts from the command-line.

SHOW_SYNOP can search data for the following instruments:

Step 2: Pre-processing

Typically, instrument data found with the VSO are unprocessed level-0 data. The PrepServer offers remote pre-processing of those data from within SHOW_SYNOP or from the IDL command-line before or after downloading to the user's computer. The big advantage is that the user does not have to maintain instrument-specific data analysis procedures or calibration files on his computer. Once the files containing the data of interest has been retrieved and prepped if necessary, the file names are displayed in the SHOW_SYNOP window (green box in Figure 5). For more details on the prep-server including accessing it from the IDL command-line, please click here

Step 3: Visualizing

The data are visualized with PLOTMAN, which handles different data types such as light curves, images, spectra, and spectrograms. It provides basic display operations such as zooming, image overlays, solar rotation, etc. To display data with PLOTMAN from within SHOW_SYNOP, simply select a data file (Figure 6, blue box) and click on "Display". If the data file has already been pre-processed, it will be displayed immediately in a PLOTMAN window. Otherwise, it is first sent to the PrepServer for processing. If multiple files have been selected, all are displayed in the same PLOTMAN window (see Figures 9, 10, and 11).

Like all other GUIs discussed in this nugget, PLOTMAN can also be called from the command-line. Examples can be found here.

IDL Command-Line Tools

Step 1: Finding the Data

The VSO search can be initiated directly from the IDL command-line using the procedure VSO_FILES. Two different search strategies are supported:

Data for the following instruments can be searched:

VSO_FILES does not download any data files. Instead, SOCK_COPY or VSO_PREP (see next section) are used.

Step 2: Pre-processing

VSO_PREP allows for data pre-processing from an IDL command-line without the requirement of a local installation of instrument software or calibration data. VSO_PREP takes as a minimum a local file or a URL to a remote file for a parameter. If a URL is provided then the PrepServer will download the data and send them back pre-processed; otherwise they are uploaded to the PrepServer, pre-processed, and downloaded.

The following instrument data can be pre-processed:

Step 3: Visualizing

PLOTMAN displays level-0 and pre-processed data. It is integrated with VSO_PREP and allows visualizing data returned by VSO_PREP with one command.

Examples

Example 1

; Step 1: Search the VSO and return a URL to the Hinode/XRT image closest to January 25 2007 06:57 UT.
; Step 2: Pre-process that data file and create an XRT object (xrt_obj)
; Step 3: Display the data file with PLOTMAN using a standard color table (see Figure 9).
 
xrt_file = vso_files('25-Jan-2007 06:57', instr='xrt')
vso_prep, xrt_file, oprep=xrt_obj
xrt_obj->plotman, /colors

Example 2

; Step 1: Search the VSO and return URLs to EIT images that have been observed between January 25 2007 06:45 and January 25 20007 07:15
; Step 2: Pre-process one EIT image at the time and...
; Step 3: ...display it with PLOTMAN using standard coloring. All images are displayed in the same PLOTMAN window.
 
eit_files = vso_files('25-Jan-2007 06:45', '25-Jan-2007 07:15', instr='eit')
FOR i=0, N_ELEMENTS(eit_files)-1 DO BEGIN $
 vso_prep, eit_files[i], oprep=eit_obj & $
 eit_obj->plotman, /colors, plotman=p & $
ENDFOR

Example 3

; Step 1: Not required
; Step 2: Use VSO_PREP to reconstruct a RHESSI clean 6-12keV image on the PrepServer
; Step 3: Display RHESSI image with PLOTMAN using standard coloring '''(see Figure XXX)'''
 
vso_prep, instrument='rhessi', im_time_interval=['25-Jan-2007 06:53:44', '25-Jan-2007 06:57:40'], image_alg='clean', im_energy_binning=[6,12], oprep=rhessi_obj
rhessi_obj->plotman, /colors

Conclusion

Documentation

Contacts

Facts about Cloudy SolarSoftwareRDF feed
RHESSI Nugget Date5 July 2010  +
RHESSI Nugget First AuthorLaszlo I. Etesi  +
RHESSI Nugget Indexwarning.png"XXX" is not a number.
RHESSI Nugget Second AuthorBrian R. Dennis  +
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox