|
|
Integrating
your DIAL Server with V0 IMS
Gateway
|
You can integrate
your Data Server with V0 IMS Gateway for
providing your data and its services to a
broader community of users by following
the steps given below. The tools
(inv2odl, dumpAttrs, Map Tables and
v0dialsrvr ) required for integrating V0
capabilities to your server are located in
the v0dialTools directory under the DIAL
installation directory.
Create
your Data Inventory File
You will have
performed this step during your DIAL
installation. If you haven't created
your data inventory file, click
here,
for a detailed set of
instructions.
Create
VALIDS Mapping Tables
Here is a brief definition of VALID and
VALIDS before going in to the subject of
creating VALIDS mapping tables.
A VALID is a value of a particular
attribute (or column in a database).
For example, "Ozone" is a keyword within
the attribute domain Parameter.
The VALIDS is the set of values (often
keywords) identified for specific
categories (i.e. parameter, source,
sensor, etc.) used to form valid search
criteria used in the Version 0 IMS
interface.
Each DIAL site is autonomous with
respect to how it names and maintains its
data and its attributes. However, each
DIAL site must be able to respond to
requests for data. In order to do this,
the V0 DIAL Server has to review the
contents of each field in the
search message and transform the contents
of each field into values that are valid
on the local DIAL site. In this way, the
values used on the DIAL site do not have
to correspond to the IMS VALIDS used by
the V0 IMS Gateway.
The DIAL distribution file provides a
VALIDS mapping tool,
MapTables, for creating your
VALIDS mapping tables. It is a Java
based GUI tool, which can be used for
mapping IMS
VALIDS to the local DIAL
VALIDS.
For generating your mapping tables,
follow the steps given below:
- Create attrlist.txt
file. This file should contain the
required attributes that need to be
mapped. For each attribute listed in
this file, the corresponding
ims_<attribute>.lst and
dial_<attribute>.lst files should
exist. As an
example,Table 1 lists all the VALIDS
lists used by the DIAL-IRONCITY data
center.
- Generate your DIAL VALIDS tables.
- Execute DIALvalids
(if your inventory is an HDF file
created using crinv)
- Execute AttrDump
(if your inventory is miniSQL
database table created using crinv)
Make sure to set the CLASSPATH to
contain the path for your mSQL-JDBC
driver classes (com
directory).
- The resulting VALIDS lists will
have the prefix dial_ and the suffix
.lst. Make sure the file name
(without the prefix and the suffix)
matches with the corresponding
attribute name in the attrlist.txt
file.
- Generate IMS VALIDS tables. IMS
staff is currently working on a tool
for generating IMS VALIDS tables and
should be available sometime within Dec
1999. At present the user has to
generate these tables manually. Click
here
for IMS VALIDS information.
- Create mapping tables by executing
MapTables . To run this
tool, type java MapTables
on command line. It will pop up a
window displaying a list of Attributes
as shown in figure 1. (contents of
attrlist.txt file).
- Move the mapping tables to
tables directory under the
distribution directory.
- .
Figure 1
Select an attribute, for example
parameter, from the list and
double click on it. A new window, Map
Attributes, as shown in figure 2 will
pop up.
Figure 2
MapAttributes window has four
columns. The first column displays
the contents of IMS VALIDS of selected
attribute. The second column
displays the contents of local DIAL site
VALIDS. The third column is the Map
Now button. Finally, the fourth
column is the result column. To map
IMS valid to your DIAL site valid, simply
click on the corresponding entries on
column 1 and column 2 and click on the Map
Now button. The result will be
displayed in the last column. When
you are done mapping all your local DIAL
sites VALIDS, click on SAVE button and
then click on QUIT. The MapTables
saves your mapped VALIDS in a file called
ims_dial_<attribute>.lst file.
|
attrlist.txt
|
List of attributes that need
to be mapped
|
|
dial_attributes.lst
|
List of DIAL attributes
|
|
ims_attributes.lst
|
List of IMS attributes
|
|
dial_parameter.lst
|
DIAL site defined set of
VALIDS for attribute
PARAMETER
|
|
ims_parameter.lst
|
IMS defined set of VALIDS for
attribute PARAMETER
|
|
dial_source.lst
|
DIAL site defined set of
VALIDS for attribute SOURCE
|
|
ims_source.lst
|
IMS defined set of VALIDS for
attribute SOURCE
|
|
dial_sensor.lst
|
DIAL site defined set of
VALIDS for attribute SENSOR
|
|
ims_sensor.lst
|
IMS defined set of VALIDS for
attribute SENSOR
|
|
dial_dataset_id.lst
|
DIAL site defined set of
VALIDS for attribute
DATASET_ID
|
|
ims_dataset_id.lst
|
IMS defined set of VALIDS for
attribute DATASET_ID
|
|
dial_processing_level.lst
|
DIAL site defined set of
VALIDS for attribute
PROCESSING_LEVEL
|
|
ims_processing_level.lst
|
IMS defined set of VALIDS for
attribute PROCESSING_LEVEL
|
|
ims_dial_dataset.lst
|
Mapped VALIDS table for the
attribute Dataset
|
|
ims_dial_parameter.lst
|
Mapped VALIDS table for the
attribute Parameter
|
|
ims_dial_source.lst
|
Mapped VALIDS table for the
attribute Source
|
|
ims_dial_sensor.lst
|
Mapped VALIDS table for the
attribute Sensor
|
|
ims_dial_processing_level.lst
|
Mapped VALIDS table for the
processing_level attribute
|
Table 1
Prepare
VALIDS for submission
In order to make your DIAL center
visible through V0 IMS Gateway, you will
have to submit VALIDS that represent your
data holdings in ODL format. We
provide a tool called
inv2odl for generating this
ODL formatted VALIDS for your data
holdings. The program "inv2odl"
reads your DIAL VALIDS (from the HDF
inventory file or from the export.txt file
containing the DIAL VALIDS information),
maps DIAL VALIDS to IMS VALIDS using the
mapping tables that were created in the
previous step, and generates an ODL
submission tree. Generate your
VALIDS submission tree by following the
steps given below:
- Edit tables/ims_valids_odl.lst and
replace DIAL-HOPS string with your DIAL
server name
- Execute Export for
creating a DIAL VALIDS file,
export.txt, if your inventory is a
database inventory. Your CLASSPATH
environment variable should contain the
path for the mSQL-JDBC driver classes
(com directory).
- Execute
inv2odl. To run
"inv2odl", type the command line as:
inv2odl <your inventory hdf file or
export.txt file> <Mapping table
path> <Output file name> (For
example, inv2odl inventory.hdf tables
valids.odl, where inventory.hdf is the
DIAL inventory file, tables is the path
for DIAL VALIDS tables and valids.odl
is the output file.
NOTE: Check
the log file, inv2odl.log, for any WARNING
or ERROR messages. Verify your
valids.odl file before submitting it to
VALIDS processing staff.
Following is an example valids.odl:
DATA_CENTER_ID
= "DIAL-HOPS"
GROUP
= DATASET
DATASET_ID
= "MATTHEWS ALBEDO"
SOURCE
= "Human Observer"
SENSOR
= "HUMAN OBSERVER"
PARAMETER
= (
"ALBEDO")
PROCESSING_LEVEL =
'4'
CAMPAIGN
= " "
DAY_NIGHT_FLAG
= " "
END_GROUP
= DATASET
GROUP
= DATASET
DATASET_ID
= "MATTHEWS CULTIVATION INTENSITY"
SOURCE
= "Human Observer"
SENSOR
= "HUMAN OBSERVER"
PARAMETER
= (
"AGRICULTURE AND FOOD SECURITY")
PROCESSING_LEVEL =
'4'
CAMPAIGN
= " "
DAY_NIGHT_FLAG
= " "
END_GROUP
= DATASET
END
Submit
your VALIDS to V0 IMS
Gateway
The procedure for
submitting your VALIDS to V0 IMS Gateway
can be found at
http://harp.gsfc.nasa.gov/v0ims/valids/valids_cleanup.html
The data centers
who are interested in participating with
the V0 DIAL Beta demonstration and
testing, can submit their VALIDS to DIAL
testing team by following the steps given
below:
- ftp to
salmon.stx.com (login as
anonymous and give your
email address for the
password)
- change
directory to incoming
- change to
binary mode
- upload your
valids.odl file
- inform us by
sending an email to
dialhelp@dial.gsfc.nasa.gov . In
your mail, make sure to provide the
following information:
- DATA
CENTER NAME
- YOUR IP
ADDRESS
- PORT
Number in which your V0 DIAL Server
will listen to incoming
messages
Run
your V0-DIAL Server
In order to run
your V0 DIAL Server, you need to perform
the following steps:
- Edit
v0dialTools/config/v0_dial.conf file
located under your DIAL installation
and
- replace
the string dial.gsfc.nasa.gov
with your server name on line 4 for
server name
- replace
the string DIAL-SERVER with
your data center name for the
variable DataCenterID
- Choose
dialmode by uncommenting
dialmode = v0_search if your
inventory file is an HDF file,
otherwise, uncomment the dialmode
= dbsearch line.
- if you are
using v0_search mode, then replace
the string
/dial/htdocs/hdf/inventry.hdf
to your inventory file and make sure
to give the complete path for the
variable lpd123_fname.
- if you are
using dbsearch mode, then provide
the database, driver and table names
for the variables defined under
dbsearch.
- Edit
v0dialTools/v0dialenv.sh file located
under your DIAL installation and
- replace
all the occurences of the
string <DIAL-2.2> with
the complete path to your DIAL
installation directory
- Check the
path for dib_search program and set
the alias for dib_search
- At the
command prompt, enter source
v0dialenv.sh
- At the
command prompt, enter v0dialsrvr
<port #> v, to run your
V0 DIAL Server.
NOTE: Make
sure that your port number matches with
the port number you have provided as part
of your valids submission.
Test
your V0-DIAL Server
Once you submit
your VALIDS to V0 IMS Gateway, you will be
informed by V0 IMS VALIDS processing
staff, once they incorporate your VALIDS
in to the development Gateway. You
can access V0 IMS development level
gateway and its users manual by using the
URL:
http://harp.gsfc.nasa.gov/~imswww/preops/imswelcome/.
If you are part
of V0 DIAL Beta testers, you will be
informed about our test gateway URL by a
separate email.
Last Update: April 1,
1999
Curator:
Lakshmi
Kumar
(lakshmi@rattler.gsfc.nasa.gov)
NASA Official:
Ken
McDonald
|
