To post-process your partitioned EnSight Gold unstructured data on fewer servers than casefiles, run SOS using an SOS casefile that has a MULTIPLE_CASEFILES section.
Three possible methods are available for your convenience. They all accomplish the same thing in slightly different ways. So use whichever is easiest for your situation.
Note: in using one of the 3 the methods below, one should determine something about how the data resides, or is available to EnSight. Namely, how will one need to specify the path to the data.
Since the whole idea is that the number of servers may vary, and EnSight will determine which casefiles go to which servers, there are really only two possibilities for paths.
There is a global path for all of the data. And therefore each server needs to know this global path (which it will prepend to each casefile).
Each casefile has its own path. And each server needs to know the path for each.
Available Section lines | Comments | |
---|---|---|
MULTIPLE_CASEFILES | Required for all methods | |
total number of cfiles | n | Used for method 1 and 2 |
cfiles global path | global_path | Optional, used for methods 1 and 2 |
cfiles | partition_1.case | Used for method 1 |
partition_2.case | ||
partition_n.case | ||
cfiles pattern | partition_*.case | Used for method 2 |
files start number | # | Used for method 2 |
cfiles increment | # | Used for method 2 |
cfiles file | filename | Used for method 3 |
Method 1
Specify the number of and the actual files in the sos casefile
Using global path
MULTIPLE_CASEFILES total number of cfiles: 3 cfiles global path: /home/bjn/data cfiles: file1.case file_b.case bruce.case
Using path per casefile
MULTIPLE_CASEFILES total number of cfiles: 3 cfiles: /home/bjn/data1/file1.case /home/bjn/data2/file_b.case /home/bjn/data3/bruce.case
Method 2
Specify the number of, the pattern, and the start and increment
Using global path
MULTIPLE_CASEFILES total number of cfiles: 3 cfiles global path: /home/bjn/data cfiles pattern: file**.case cfiles start number: 0 cfiles increment: 1 OR MULTIPLE_CASEFILES total number of cfiles: 3 cfiles pattern: /home/bjn/data/file**.case cfiles start number: 0 cfiles increment: 1
Using path per casefile
Note: Method 2 does not have a way to have a separate path for each casefile.
Method 3
Similar to 1, but place the info in a separate file
Using global path
MULTIPLE_CASEFILES cfiles file: all_together_cfiles.txt
and in all_together_cfiles.txt,(first line contains number of, second line contains the optional global path, then filenames come 1 per line on the following lines). Like:
3 /home/bjn/data file1.case file_b.case bruce.case
Using path per casefile
MULTIPLE_CASEFILES cfiles file: separated_cfiles.txt
and in separated_cfiles.txt, (first line contains number of, second line must be the word "none" - indicating no global path specified, then filenames come 1 per line on the following lines). Like:
3 none /home/bjn/data1/file1.case /home/bjn/data2/file_b.case /home/bjn/data3/bruce.case
An EnSight Gold unstructured transient geometry model with a couple of variables, in 4 partitions, like:
bjn1.case |
bjn2.case |
bjn3.case |
bjn4.case |
bjn1.geo0000 |
bjn2.geo0000 |
bjn3.geo0000 |
bjn4.geo0000 |
bjn1.geo0001 |
bjn2.geo0001 |
bjn3.geo0001 |
bjn4.geo0001 |
bjn1.scalar0000 |
bjn2.scalar0000 |
bjn3.scalar0000 |
bjn4.scalar0000 |
bjn1.scalar0001 |
bjn2.scalar0001 |
bjn3.scalar0001 |
bjn4.scalar0001 |
bjn1.evector0000 |
bjn2.evector0000 |
bjn3.evector0000 |
bjn4.evector0000 |
bjn1.evector0001 |
bjn2.evector0001 |
bjn3.evector0001 |
bjn4.evector0001 |
Using Method 1
If they all reside in the same directory (/home/bjn), a method 1 SOS casefile that will use just 2 servers (perhaps named bjn_4x2.sos) should look like:
FORMAT type: master_server gold MULTIPLE_CASEFILES total number of cfiles: 4 cfiles global path: /home/bjn cfiles: bjn1.case bjn2.case bjn3.case bjn4.case SERVERS number of servers: 2 repeat machine id: gun executable: ensight_server
Using Method 2
If they all reside in the same directory (/home/bjn), a method 2 SOS casefile that will use just 2 servers should look like:
FORMAT type: master_server gold MULTIPLE_CASEFILES total number of cfiles: 4 cfiles global path: /home/bjn cfiles pattern: bjn*.case cfiles start number: 1 cfiles increment: 1 SERVERS number of servers: 2 repeat machine id: gun executable: ensight_server
Using Method 3
For this one, lets change things and say that they reside in separate directories, like:
/scratch/portion1 |
/scratch/portion2 |
/scratch/portion3 |
/scratch/portion4 |
bjn1.case bjn1.geo0000 bjn1.geo0001 bjn1.scalar0000 bjn1.scalar0001 bjn1.evector0000 bjn1.evector0001 |
bjn2.case bjn2.geo0000 bjn2.geo0001 bjn2.scalar0000 bjn2.scalar0001 bjn2.evector0000 bjn2.evector0001 |
bjn3.case bjn3.geo0000 bjn3.geo0001 bjn3.scalar0000 bjn3.scalar0001 bjn3.evector0000 bjn3.evector0001 |
bjn4.case bjn4.geo0000 bjn4.geo0001 bjn4.scalar0000 bjn4.scalar0001 bjn4.evector0000 bjn4.evector0001 |
The SOS casefile could look like
FORMAT type: master_server gold MULTIPLE_CASEFILES cfiles file: /scratch/bjn.txt SERVERS number of servers: 2 repeat machine id: gun executable: ensight_server and the /scratch/bjn.txt file could look like: 4 none /scratch/portion1/bjn1.case /scratch/portion2/bjn2.case /scratch/portion3/bjn3.case /scratch/portion4/bjn4.case
or could look like: (See the Other Notes below)
4 /scratch portion1/bjn1.case portion2/bjn2.case portion3/bjn3.case portion4/bjn4.case