Difference between revisions of "Install the TELEMAC system"

From SourceWiki
Jump to navigation Jump to search
Line 203: Line 203:
 
RUN_MPI="mpirun -machinefile mpirun.txt -np <N> <EXE>"
 
RUN_MPI="mpirun -machinefile mpirun.txt -np <N> <EXE>"
 
</pre></code>
 
</pre></code>
 +
 +
If anything needed modification, you also need to run the <code>cfgmak</code> command again to regenerate <code>cfgmak.mak</code> file.
  
 
=== Compilation ===
 
=== Compilation ===

Revision as of 06:33, 15 August 2007


This article describes how to download, configure and compile a full installation of the TELEMAC system to be used with ESTEL-2D and ESTEL-3D.

Downloading the TELEMAC system

To download the code, it is recommended to use " subversion" and the meta project systel90-meta. This will download from the server the full dependencies for ESTEL-3D and ESTEL-2D.

From now on, we assume that the user wants to install the TELEMAC system into the systel90 folder located at /path/to/systel90/. Starting from the directory /path/to, the subversion command to use is:

$ svn checkout http://source.ggy.bris.ac.uk/subversion/systel90-meta systel90

This will create a systel90 folder containing all necessary source files for the TELEMAC system. The typical folder tree obtained after downloading is shown at the bottom of this page.

Configuration

Before being able to compile the TELEMAC system, a few configuration steps are necessary.

Paths

The executable files for the TELEMAC system are located in the bin/ directory of the systel90tree. The directory needs to be added to the PATH variable of the user. Moreover, the TELEMAC launching scripts require the current directory (./) to be in the PATH as well. A typical entry in a user login file (for instance .bashrc) would be:

PATH=./:/path/to/systel90/bin:$PATH
export PATH

systel.ini

The folder config-template/ contains an example configuration file. By default, the TELEMAC system looks for configuration files in the config/ directory of the systel90 tree. To get started, one can simply rename config-template/ to config/:

$ mv config-template config

Then, the file systel.ini in /path/to/systel90/config needs editing. This files contains a number of sections.

The [GENERAL] section

The [GENERAL] section starts with the default language and version number for each modules in the TELEMAC system. This consists of a long list of LNGcode (use for the default language) and VERScode (used for the version) lines. By default, this file is setup for the English language (value2, French is value 1) and version "v5p7". For instance, for ESTEL-3D, the entries are:

#---ESTEL3D
LNGESTEL3=2
VERSESTEL3=v5p7

This section finish with the location of the systel90 tree (variable PROJECT)and the type of machine (variable HOSTTYPE).

If the systel90 tree is installed in /path/to/systel90, then the PROJECT variable should be set /path/to/systel90.

There is no predefined value to enter for the HOSTTYPE variable, the user is free to set the HOSTTYPE freely but it is usual to use a string which can be used to identify a combination of the type computer, the operating system and the Fortran compiler. For instance, if the machine is a 32-bit Linux machine (x86 type) using the Portland Group compiler, one could use "linux-x86-pgf90". For a 64-bit machine (x86_64 type) using the Intel Fortran compiler, one could use "linux-x86_64-ifort", this is the string used in the example systel.ini but is merely an example.

PROJECT=/path/to/systel90
HOSTTYPE=linux-x86_64-ifort

These values are used at a later stage to recognise which compiler option and which pre-compiled versions of the libraries to use at runtime, see below.

The [PERL] section

The [PERL] section is used to give the location of the perl executable (PERLPATH) and the location of the perl library (PERL5LIB). On a typical Linux system, these two locations can be easily found by looking into the file system:

$ which perl
/usr/bin/perl

$ ls /usr/lib/perl*
5.8.5  5.8.6  5.8.7  5.8.8 

Note that Linux systems sometimes include several versions of the perl library, the highest number of the perl 5 library is appropriate. Therefore, on this particular system, the [PERL] section would be:

[PERL]
PERLPATH=/usr/bin
PERL5LIB=/usr/lib/perl5/5.8.8

The hosttype configurations

The final section of the systel.ini file is a list of configuration options for a given HOSTTYPE. There can be several lists, they are identified by an entry inside square brackets. One of these entries must match the HOSTTYPE variable defined in the [GENERAL] section of the file. This is a convenient way of changing configuration options by editing one single line in the systel.ini file.

A list of configuration options consists of series of a set of keywords related to the compiler, the linker, the archiver (and the MPI library if installed). For instance when using the Intel Fortran compiler of a 64-bit Linux machine, one could have:

[linux-x86_64-ifort]
DIRLIB=linux-x86_64-ifort
FC_NAM="ifort"
FC_OPT_OBJEXT= "o"
FC_OPT_COMPIL= " -O2 -c "
FC_OPT_DEBUG=  " -g -DD -debug extended -debug-parameters "
FC_OPT_PROFILE=" -O2 "
FC_OPT_INCLUDE=" -I "
FC_OPT_OTHERS= " -warn all -implicitnone -traceback "

LK_NAM="ifort"
LK_OPT_NORMAL=" -lm -lstdc++ "
LK_OPT_DEBUG=  " -g -DD -debug extended -debug-parameters "
LK_OPT_PROFILE=" -pg "
LK_OPT_OUTNAME=" -o "
LK_OPT_OTHERS=" -O2 "

LIB_NAM=ar
LIB_OPT_LIBEXT="a"
LIB_OPT_OUTNAME=" cru"
LIB_OPT_OTHERS=
LIB_RANLIB=
LIBS_MPI=" "

RUN_DEBUG=" idb -gui "
RUN_PROFILE=

FC_MPI="mpif90 -c "
LK_MPI="mpif90 -lm -lstdc++ -o <EXE>  <OBJS>  <LIBS> "
LIBS_MPI="-L/path/to/mpi/lib "
RUN_MPI="mpirun -machinefile mpirun.txt -np <N> <EXE>"

Give more detail!

Refer to the documentation about the compiler to understand these options.

The section with the variables ending in "_MPI" is required when the TELEMAC system will be run in parallel on a cluster or network of computers. This is described below.

cfgmak.mak

When the configuration of systel.ini is done, one must create a configuration file for the compilation. This is done automatically when issuing the command:

$ cfgmak
File '/path/to/systel90/config/cfgmak.mak' updated.

This will create a file called cfgmak.mak in the same directory as systel.ini. cfgmak.mak should not be edited manually, any configuration change should be done in systel.ini and the command cfgmak will update cfgmak.mak accordingly.

Compilation

After the cfgmak.mak file has been created, it is possible to start to compile the TELEMAC system. This is a simple but long operation unless a compilation script is used to automate the process. Each module in the TELEMAC system needs to be compiled, in a particular order. Furthermore, some modules (parallel and estel3d have external dependencies which need to be dealt with before the compilation.

The maktel command

The standard way to compile a module of the TELEMAC system consist of going into the sources/ directory of the module and using the command:

maktel Menage install

This will delete all existing objects in the sources/ directory, recompile the module and install the module library in a folder called after the DIRLIB entry in the systel.ini file. For instance using the linux-x86_64-ifort example the library for estel3d v5p7 would go in /path/to/systel90/estel3d/estel3d_v5p7/linux-x86_64-ifort/.

If only some source files are updated, maktel all will recompile the source files and maktel install will install the library into its destination.

Compilation order

The modules need to be compiled in the following order:

  1. damocles
  2. paravoid
  3. parallel (attention, requires extra operations)
  4. bief
  5. special
  6. sisyphe
  7. telemac2d
  8. estel2d
  9. estel3d (attention, requires extra operations)

For each module, navigate into the sources/ directory of the version of the module defined in the systel.ini file and issue the command:

maktel Menage install

Note that parallel and estel3d require some extra steps, see below.

parallel

parallel is an optional library. The TELEMAC system can be compiled and used without it. The parallel module is used to run the TELEMAC system on a parallel computer or network of computers. It requires the "metis" and "MPI" libraries to be installed.

metis

metis is a mesh partitionning library. Although not developed as part of the TELEMAC project, it is distributed with parallel for convenience. The compilation of metis is simple on Linux but requires some manual steps. It requires a C compiler to be installed. In particular, the destination library needs to be created by hand:

$ cd /path/to/systel90/parallel/parallel_v5p7
$ cd metis_distrib
$ cd metis-4.0
$ make clean
$ make
$ cd /path/to/systel90/parallel/parallel_v5p7
$ mkdir linux-x86_64-ifort
$ cp metis_distrib/metis-4.0/libmetis.a linux-x86_64-ifort/.

MPI

The "MPI" message parsing interface is also required to compile parallel and use the TELEMAC system in parallel.

MPI can be downloaded from http://www-unix.mcs.anl.gov/mpi/mpich2/. Install MPI and the MPI Fortran 90 compiler (mpif90) according to the MPI documentation. From now on, we assume that MPI is installed in the directory /path/to/mpi which contains the bin/, lib/ and include/ directories. Furthermore, the MPI Fortran 90 compiler mpif90 needs to be in the user's PATH; which often requires the following entry in the user's .bashrc file:

PATH=/path/to/mpi/bin:$PATH
export PATH

When MPI is installed and configured, the systel.ini can be adjusted if necessary. It contains 4 lines related to the MPI configuration at the end of each hosttype section. Usually, only the LIBS_MPI variable needs adjusting:

FC_MPI="mpif90 -c "
LK_MPI="mpif90 -lm -lstdc++ -o <EXE>  <OBJS>  <LIBS> "
LIBS_MPI="-L/path/to/mpi/lib "
RUN_MPI="mpirun -machinefile mpirun.txt -np <N> <EXE>"

If anything needed modification, you also need to run the cfgmak command again to regenerate cfgmak.mak file.

Compilation

before being able to compile parallel, the makefile in the sources/ directory needs to be edited to point to the relevant MPI include/ folder:

INCMPI        = /path/to/mpi/include


cd sources
maktel Menage install

estel3d

It is recommended to activate the Tecplot binary output for estel3d to increase performance and reduce results file size. A few manual steps are required for this purpose.

Install the Tecplot library

Your installation of Tecplot provides the Tecplot TecIO library called tecio.a (32-bit machines) or tecio64.a (64-bit machines) and located in the lib directory of the Tecplot install. It is necessary to copy this file into the systel90 tree.

$ mkdir -p /path/to/systel90/tecplot/tecplot_v10/linux-x86_64-ifort
$ cp /path/to/tecplot/lib/tecio64.a /path/to/systel90/tecplot/tecplot_v10/linux-x86_64-ifort/tecplot_v10.a

Modify the makefile

Tecplot 10:

FORMAT_OUT = 10 

Tecplot 11 (360):

FORMAT_OUT = 110

No Tecplot library:

FORMAT_OUT = ONLY_ASCII

Compile estel3d

maktel cleanall install

Final TELEMAC tree

  • systel90
    • bief
      • bief_v5p7
        • sources
      • bief_v5p8
        • sources
    • bin
    • config-template
    • damocles
      • damo_v5p7
        • sources
      • damo_v5p8
        • sources
    • estel2d
      • estel2d_v5p7
        • lib
        • sources
        • test.gb
      • estel2d_v5p8
        • lib
        • sources
        • test.gb
    • estel3d
      • estel2d_v5p7
        • sources
        • test.gb
      • estel2d_v5p8
        • sources
        • test.gb
    • parallel
      • parallel_v5p7
        • metis_distrib
        • sources
      • parallel_v5p8
        • metis_distrib
        • sources
    • paravoid
      • paravoid_v5p7
        • sources
      • paravoid_v5p8
        • sources
    • special
      • special_v5p7
        • sources
      • special_v5p8
        • sources
    • sisyphe
      • sisyphe_v5p7
        • lib
        • sources
        • sources_util
      • sisyphe_v5p8
        • lib
        • sources
        • sources_util
    • telemac2d
      • tel2d_v5p7
        • lib
        • sources
      • tel2d_v5p8
        • lib
        • sources