model blow up in 7th year of climatological run

Discussion on computers, ROMS installation and compiling

Moderators: arango, robertson

Post Reply
Message
Author
navin
Posts: 12
Joined: Mon Jun 08, 2015 4:40 pm
Location: Indian Institute of Technology Delhi

model blow up in 7th year of climatological run

#1 Unread post by navin »

Hi all I am trying to run a climatological simulation for 10 year. ahere is the my model configuration

Model Input Parameters: ROMS/TOMS version 3.7
Saturday - January 28, 2017 - 11:38:08 AM
-----------------------------------------------------------------------------

Ganga Basin

Operating system : Linux
CPU/hardware : x86_64
Compiler system : gfortran
Compiler command : /usr/bin/mpif90
Compiler flags : -frepack-arrays -O3 -ffast-math -ffree-form -ffree-line-length-none -ffree-form -ffree-line-length-none

Input Script :

SVN Root URL : https://www.myroms.org/svn/src/trunk
SVN Revision : 820M

Local Root : /home/adrao/navin/roms/trunk
Header Dir : /home/adrao/navin/project/ganga_basin
Header file : basin.h
Analytical Dir: /home/adrao/navin/project/ganga_basin

Resolution, Grid 01: 0161x0094x030, Parallel Nodes: 12, Tiling: 004x003


Physical Parameters, Grid: 01
=============================

10368400 ntimes Number of timesteps for 3-D equations.
300.000 dt Timestep size (s) for 3-D equations.
60 ndtfast Number of timesteps for 2-D equations between
each 3D timestep.
1 ERstr Starting ensemble/perturbation run number.
1 ERend Ending ensemble/perturbation run number.
0 nrrec Number of restart records to read from disk.
T LcycleRST Switch to recycle time-records in restart file.
288 nRST Number of timesteps between the writing of data
into restart fields.
1 ninfo Number of timesteps between print of information
to standard output.
T ldefout Switch to create a new output NetCDF file(s).
0 nHIS Number of timesteps between the writing fields
into history file.
0 nQCK Number of timesteps between the writing fields
into quicksave file.
1 ntsAVG Starting timestep for the accumulation of output
time-averaged data.
288 nAVG Number of timesteps between the writing of
time-averaged data into averages file.
103680 ndefAVG Number of timesteps between creation of new
time-averaged file.
0 ntsDIA Starting timestep for the accumulation of output
time-averaged diagnostics data.
10368 nDIA Number of timesteps between the writing of
time-averaged data into diagnostics file.
103680 ndefDIA Number of timesteps between creation of new
diagnostic file.
5.0000E+00 nl_tnu2(01) NLM Horizontal, harmonic mixing coefficient
(m2/s) for tracer 01: temp
5.0000E+00 nl_tnu2(02) NLM Horizontal, harmonic mixing coefficient
(m2/s) for tracer 02: salt
5.0000E+00 nl_visc2 NLM Horizontal, harmonic mixing coefficient
(m2/s) for momentum.
F LuvSponge Turning OFF sponge on horizontal momentum.
F LtracerSponge(01) Turning OFF sponge on tracer 01: temp
F LtracerSponge(02) Turning OFF sponge on tracer 02: salt
1.0000E-06 Akt_bak(01) Background vertical mixing coefficient (m2/s)
for tracer 01: temp
1.0000E-06 Akt_bak(02) Background vertical mixing coefficient (m2/s)
for tracer 02: salt
1.0000E-05 Akv_bak Background vertical mixing coefficient (m2/s)
for momentum.
1.0000E-04 rdrg Linear bottom drag coefficient (m/s).
1.0000E-03 rdrg2 Quadratic bottom drag coefficient.
2.0000E-02 Zob Bottom roughness (m).
1 lmd_Jwt Jerlov water type.
2 Vtransform S-coordinate transformation equation.
4 Vstretching S-coordinate stretching function.
6.0000E+00 theta_s S-coordinate surface control parameter.
0.0000E+00 theta_b S-coordinate bottom control parameter.
10.000 Tcline S-coordinate surface/bottom layer width (m) used
in vertical coordinate stretching.
1027.000 rho0 Mean density (kg/m3) for Boussinesq approximation.
0.000 dstart Time-stamp assigned to model initialization (days).
-1.00 time_ref Reference time for units attribute (yyyymmdd.dd)
3.6000E+02 Tnudg(01) Nudging/relaxation time scale (days)
for tracer 01: temp
3.0000E+01 Tnudg(02) Nudging/relaxation time scale (days)
for tracer 02: salt
3.6000E+02 Znudg Nudging/relaxation time scale (days)
for free-surface.
3.6000E+02 M2nudg Nudging/relaxation time scale (days)
for 2D momentum.
3.6000E+02 M3nudg Nudging/relaxation time scale (days)
for 3D momentum.
1.2000E+02 obcfac Factor between passive and active
open boundary conditions.
F VolCons(1) NLM western edge boundary volume conservation.
F VolCons(2) NLM southern edge boundary volume conservation.
F VolCons(3) NLM eastern edge boundary volume conservation.
F VolCons(4) NLM northern edge boundary volume conservation.
-0.278 T0 Background potential temperature (C) constant.
34.649 S0 Background salinity (PSU) constant.
1.000 gamma2 Slipperiness variable: free-slip (1.0) or
no-slip (-1.0).
F LuvSrc Turning OFF momentum point Sources/Sinks.
F LwSrc Turning OFF volume influx point Sources/Sinks.
F LtracerSrc(01) Turning OFF point Sources/Sinks on tracer 01: temp
F LtracerSrc(02) Turning OFF point Sources/Sinks on tracer 02: salt
F LsshCLM Turning OFF processing of SSH climatology.
F Lm2CLM Turning OFF processing of 2D momentum climatology.
F Lm3CLM Turning OFF processing of 3D momentum climatology.
T LtracerCLM(01) Turning ON processing of climatology tracer 01: temp
T LtracerCLM(02) Turning ON processing of climatology tracer 02: salt
F LnudgeM2CLM Turning OFF nudging of 2D momentum climatology.
F LnudgeM3CLM Turning OFF nudging of 3D momentum climatology.
F LnudgeTCLM(01) Turning OFF nudging of climatology tracer 01: temp
F LnudgeTCLM(02) Turning OFF nudging of climatology tracer 02: salt



Output/Input Files:

Output Restart File: ocean_rst.nc
Prefix for Averages Files: ocean_avg
Prefix for Diagnostics Files: ocean_dia
Input Grid File: roms_grd.nc
Input Nonlinear Initial File: roms_ini.nc
Input Forcing File 01: roms_frc.nc
Input Climatology File: roms_clm.nc
Input Boundary File: roms_bry.nc

Tile partition information for Grid 01: 0161x0094x0030 tiling: 004x003

tile Istr Iend Jstr Jend Npts

0 1 40 1 31 37200
1 41 81 1 31 38130
2 82 122 1 31 38130
3 123 161 1 31 36270
4 1 40 32 63 38400
5 41 81 32 63 39360
6 82 122 32 63 39360
7 123 161 32 63 37440
8 1 40 64 94 37200
9 41 81 64 94 38130
10 82 122 64 94 38130
11 123 161 64 94 36270

Tile minimum and maximum fractional coordinates for Grid 01:
(interior points only)

tile Xmin Xmax Ymin Ymax grid

0 0.50 40.50 0.50 31.50 RHO-points
1 40.50 81.50 0.50 31.50 RHO-points
2 81.50 122.50 0.50 31.50 RHO-points
3 122.50 161.50 0.50 31.50 RHO-points
4 0.50 40.50 31.50 63.50 RHO-points
5 40.50 81.50 31.50 63.50 RHO-points
6 81.50 122.50 31.50 63.50 RHO-points
7 122.50 161.50 31.50 63.50 RHO-points
8 0.50 40.50 63.50 94.50 RHO-points
9 40.50 81.50 63.50 94.50 RHO-points
10 81.50 122.50 63.50 94.50 RHO-points
11 122.50 161.50 63.50 94.50 RHO-points

0 1.00 40.50 0.50 31.50 U-points
1 40.50 81.50 0.50 31.50 U-points
2 81.50 122.50 0.50 31.50 U-points
3 122.50 161.00 0.50 31.50 U-points
4 1.00 40.50 31.50 63.50 U-points
5 40.50 81.50 31.50 63.50 U-points
6 81.50 122.50 31.50 63.50 U-points
7 122.50 161.00 31.50 63.50 U-points
8 1.00 40.50 63.50 94.50 U-points
9 40.50 81.50 63.50 94.50 U-points
10 81.50 122.50 63.50 94.50 U-points
11 122.50 161.00 63.50 94.50 U-points

0 0.50 40.50 1.00 31.50 V-points
1 40.50 81.50 1.00 31.50 V-points
2 81.50 122.50 1.00 31.50 V-points
3 122.50 161.50 1.00 31.50 V-points
4 0.50 40.50 31.50 63.50 V-points
5 40.50 81.50 31.50 63.50 V-points
6 81.50 122.50 31.50 63.50 V-points
7 122.50 161.50 31.50 63.50 V-points
8 0.50 40.50 63.50 94.00 V-points
9 40.50 81.50 63.50 94.00 V-points
10 81.50 122.50 63.50 94.00 V-points
11 122.50 161.50 63.50 94.00 V-points

Maximum halo size in XI and ETA directions:

HaloSizeI(1) = 106
HaloSizeJ(1) = 88
TileSide(1) = 47
TileSize(1) = 1786


Lateral Boundary Conditions: NLM
============================

Variable Grid West Edge South Edge East Edge North Edge
--------- ---- ---------- ---------- ---------- ----------

zeta 1 Closed Chapman Imp Closed Closed

ubar 1 Closed Flather Closed Closed

vbar 1 Closed Flather Closed Closed

u 1 Closed Rad + Nud Closed Closed

v 1 Closed Rad + Nud Closed Closed

temp 1 Closed Rad + Nud Closed Closed

salt 1 Closed Rad + Nud Closed Closed

Activated C-preprocessing Options:

basin Ganga Basin
ANA_BSFLUX Analytical kinematic bottom salinity flux.
ANA_BTFLUX Analytical kinematic bottom temperature flux.
ANA_FSOBC Analytical free-surface boundary conditions.
ANA_M2OBC Analytical 2D momentum boundary conditions.
ANA_SMFLUX Analytical kinematic surface momentum flux.
ANA_SSFLUX Analytical kinematic surface salinity flux.
ANA_STFLUX Analytical kinematic surface temperature flux.
ASSUMED_SHAPE Using assumed-shape arrays.
AVERAGES Writing out time-averaged nonlinear model fields.
CURVGRID Orthogonal curvilinear grid.
DIAGNOSTICS_TS Computing and writing tracer diagnostic terms.
DIAGNOSTICS_UV Computing and writing momentum diagnostic terms.
DIURNAL_SRFLUX Modulate shortwave radiation by the local diurnal cycle.
DJ_GRADPS Parabolic Splines density Jacobian (Shchepetkin, 2002).
DOUBLE_PRECISION Double precision arithmetic.
LMD_BKPP KPP bottom boundary layer mixing.
LMD_CONVEC LMD convective mixing due to shear instability.
LMD_MIXING Large/McWilliams/Doney interior mixing.
LMD_NONLOCAL LMD convective nonlocal transport.
LMD_RIMIX LMD diffusivity due to shear instability.
LMD_SKPP KPP surface boundary layer mixing.
MASKING Land/Sea masking.
MIX_S_TS Mixing of tracers along constant S-surfaces.
MIX_S_UV Mixing of momentum along constant S-surfaces.
MPI MPI distributed-memory configuration.
NONLINEAR Nonlinear Model.
NONLIN_EOS Nonlinear Equation of State for seawater.
POWER_LAW Power-law shape time-averaging barotropic filter.
PROFILE Time profiling activated .
QCORRECTION Surface net heat flux correction.
!RST_SINGLE Double precision fields in restart NetCDF file.
SALINITY Using salinity.
SCORRECTION Surface salinity flux correction.
SOLAR_SOURCE Solar Radiation Source Term.
SOLVE3D Solving 3D Primitive Equations.
TS_C4HADVECTION Fourth-order centered horizontal advection of tracers.
TS_C4VADVECTION Fourth-order centered vertical advection of tracers.
TS_DIF2 Harmonic mixing of tracers.
UV_ADV Advection of momentum.
UV_COR Coriolis term.
UV_U3HADVECTION Third-order upstream horizontal advection of 3D momentum.
UV_C4VADVECTION Fourth-order centered vertical advection of momentum.
UV_LDRAG Linear bottom stress.
UV_VIS2 Harmonic mixing of momentum.
VAR_RHO_2D Variable density barotropic mode.

Process Information:

Node # 11 (pid= 19328) is active.
Node # 0 (pid= 19317) is active.
Node # 1 (pid= 19318) is active.
Node # 2 (pid= 19319) is active.
Node # 3 (pid= 19320) is active.
Node # 4 (pid= 19321) is active.
Node # 5 (pid= 19322) is active.
Node # 6 (pid= 19323) is active.
Node # 7 (pid= 19324) is active.
Node # 8 (pid= 19325) is active.
Node # 9 (pid= 19326) is active.
Node # 10 (pid= 19327) is active.

INITIAL: Configuring and initializing forward nonlinear model ...
*******

Vertical S-coordinate System, Grid 01:

level S-coord Cs-curve Z at hmin at hc half way at hmax

30 0.0000000 0.0000000 0.000 0.000 0.000 0.000
29 -0.0333333 -0.0001000 -0.224 -0.167 -0.394 -0.461
28 -0.0666667 -0.0004039 -0.450 -0.335 -0.921 -1.187
27 -0.1000000 -0.0009240 -0.679 -0.505 -1.590 -2.193
26 -0.1333333 -0.0016812 -0.911 -0.675 -2.415 -3.508
25 -0.1666667 -0.0027057 -1.147 -0.847 -3.414 -5.170
24 -0.2000000 -0.0040388 -1.387 -1.020 -4.615 -7.234
23 -0.2333333 -0.0057340 -1.632 -1.195 -6.054 -9.767
22 -0.2666667 -0.0078592 -1.883 -1.373 -7.774 -12.860
21 -0.3000000 -0.0104998 -2.140 -1.552 -9.832 -16.623
20 -0.3333333 -0.0137617 -2.406 -1.735 -12.297 -21.193
19 -0.3666667 -0.0177759 -2.681 -1.922 -15.254 -26.740
18 -0.4000000 -0.0227035 -2.969 -2.114 -18.809 -33.475
17 -0.4333333 -0.0287422 -3.272 -2.310 -23.092 -41.653
16 -0.4666667 -0.0361343 -3.593 -2.514 -28.262 -51.591
15 -0.5000000 -0.0451767 -3.936 -2.726 -34.512 -63.673
14 -0.5333333 -0.0562320 -4.305 -2.948 -42.081 -78.371
13 -0.5666667 -0.0697441 -4.708 -3.182 -51.258 -96.262
12 -0.6000000 -0.0862553 -5.150 -3.431 -62.400 -118.051
11 -0.6333333 -0.1064281 -5.641 -3.699 -75.940 -144.598
10 -0.6666667 -0.1310722 -6.192 -3.989 -92.407 -176.956
9 -0.7000000 -0.1611766 -6.816 -4.306 -112.451 -216.410
8 -0.7333333 -0.1979496 -7.528 -4.656 -136.862 -264.530
7 -0.7666667 -0.2428669 -8.349 -5.048 -166.607 -323.235
6 -0.8000000 -0.2977313 -9.303 -5.489 -202.867 -394.867
5 -0.8333333 -0.3647446 -10.419 -5.990 -247.082 -482.287
4 -0.8666667 -0.4465964 -11.732 -6.566 -301.016 -588.991
3 -0.9000000 -0.5465716 -13.288 -7.233 -366.818 -719.248
2 -0.9333333 -0.6686826 -15.138 -8.010 -447.117 -878.273
1 -0.9666667 -0.8178301 -17.349 -8.922 -545.123 -1072.434
0 -1.0000000 -1.0000000 -20.000 -10.000 -664.755 -1309.510

Time Splitting Weights for Grid 01: ndtfast = 60 nfast = 83
==================================

Primary Secondary Accumulated to Current Step

1-0.0003540175431531 0.0166666666666667-0.0003540175431531 0.0166666666666667

82 0.0038385045257688 0.0000646481340986 0.9999596164798544 0.9999993269413311
83 0.0000403835201457 0.0000006730586691 1.0000000000000000 1.0000000000000002

ndtfast, nfast = 60 83 nfast/ndtfast = 1.38333

Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):

1.000000000000 1.029032332991 0.514516166496 1.000000000000 1.000000000000

Power filter parameters, Fgamma, gamma = 0.28400 0.23667

Metrics information for Grid 01:
===============================

Minimum X-grid spacing, DXmin = 4.07572682E+00 km
Maximum X-grid spacing, DXmax = 4.17722842E+00 km
Minimum Y-grid spacing, DYmin = 4.07742924E+00 km
Maximum Y-grid spacing, DYmax = 4.17672927E+00 km
Minimum Z-grid spacing, DZmin = 2.23555236E-01 m
Maximum Z-grid spacing, DZmax = 2.37076156E+02 m

Minimum barotropic Courant Number = 2.37124800E-02
Maximum barotropic Courant Number = 1.91894937E-01
Maximum Coriolis Courant Number = 1.68779012E-02


NLM: GET_STATE - Read state initial conditions, t = 0 00:00:00
(Grid 01, File: roms_ini.nc, Rec=0001, Index=1)
- free-surface
(Min = 0.00000000E+00 Max = 0.00000000E+00)
- vertically integrated u-momentum component
(Min = 0.00000000E+00 Max = 0.00000000E+00)
- vertically integrated v-momentum component
(Min = 0.00000000E+00 Max = 0.00000000E+00)
- u-momentum component
(Min = 0.00000000E+00 Max = 0.00000000E+00)
- v-momentum component
(Min = 0.00000000E+00 Max = 0.00000000E+00)
- potential temperature
(Min = 5.91923258E+00 Max = 2.74125346E+01)
- salinity
(Min = 2.85027803E+01 Max = 3.50388689E+01)
GET_2DFLD - solar shortwave radiation flux, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 4.08869648E-05 Max = 4.24838710E-05)
GET_2DFLD - sea surface temperature climatology, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.47006241E+01 Max = 2.60613308E+01)
GET_2DFLD - surface net heat flux sensitivity to SST, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -7.37848173E-06 Max = -5.43064414E-06)
GET_2DFLD - sea surface salinity climatology, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.06685009E+01 Max = 2.92665501E+01)
GET_NGFLD - 3D u-momentum southern boundary condition, t = 345 00:00:00
(Rec=0000012, Index=2, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -1.60102251E-02 Max = -0.00000000E+00)
GET_NGFLD - 3D v-momentum southern boundary condition, t = 345 00:00:00
(Rec=0000012, Index=2, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -1.15041479E-01 Max = 1.87374092E-01)
GET_NGFLD - temperature southern boundary condition, t = 345 00:00:00
(Rec=0000012, Index=2, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 5.85967228E+00 Max = 2.86468238E+01)
GET_NGFLD - salinity southern boundary condition, t = 345 00:00:00
(Rec=0000012, Index=2, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.83652836E+01 Max = 3.50455970E+01)
GET_3DFLD - potential temperature climatology, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_clm.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 5.85952212E+00 Max = 2.87330165E+01)
GET_3DFLD - salinity climatology, t = 345 00:00:00
(Rec=0000012, Index=1, File: roms_clm.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.83652836E+01 Max = 3.50455970E+01)

Basin information for Grid 01:

Maximum grid stiffness ratios: rx0 = 2.207350E-01 (Beckmann and Haidvogel)
rx1 = 2.429055E+00 (Haney)

Initial basin volumes: TotVolume = 1.7564687198E+13 m3
MinVolume = 3.7571549879E+06 m3
MaxVolume = 4.1353152409E+09 m3
Max/Min = 1.1006506929E+03

NL ROMS/TOMS: started time-stepping: (Grid: 01 TimeSteps: 00000001 - 10368400)

GET_2DFLD - solar shortwave radiation flux, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 4.54222932E-05 Max = 4.80999585E-05)
GET_2DFLD - sea surface temperature climatology, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.37934224E+01 Max = 2.50115380E+01)
GET_2DFLD - surface net heat flux sensitivity to SST, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -7.04108909E-06 Max = -5.16924856E-06)
GET_2DFLD - sea surface salinity climatology, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_frc.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.58551006E+01 Max = 3.04863005E+01)
GET_NGFLD - 3D u-momentum southern boundary condition, t = 15 00:00:00
(Rec=0000001, Index=1, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -1.69484566E-02 Max = -0.00000000E+00)
GET_NGFLD - 3D v-momentum southern boundary condition, t = 15 00:00:00
(Rec=0000001, Index=1, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = -1.39568958E-01 Max = 1.08149257E-01)
GET_NGFLD - temperature southern boundary condition, t = 15 00:00:00
(Rec=0000001, Index=1, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 5.91955336E+00 Max = 2.72979432E+01)
GET_NGFLD - salinity southern boundary condition, t = 15 00:00:00
(Rec=0000001, Index=1, File: roms_bry.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 3.08122848E+01 Max = 3.50358070E+01)
GET_3DFLD - potential temperature climatology, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_clm.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 5.91923258E+00 Max = 2.74125346E+01)
GET_3DFLD - salinity climatology, t = 15 00:00:00
(Rec=0000001, Index=2, File: roms_clm.nc)
(Tmin= 15.0000 Tmax= 345.0000)
(Min = 2.85027803E+01 Max = 3.50388689E+01)

STEP Day HH:MM:SS KINETIC_ENRG POTEN_ENRG TOTAL_ENRG NET_VOLUME
C => (i,j,k) Cu Cv Cw Max Speed

0 0 00:00:00 1.388118E-15 1.960811E+03 1.960811E+03 2.023138E+13
(136,01,04) 0.000000E+00 4.306884E-08 0.000000E+00 8.479950E-07
DEF_AVG - creating average file, Grid 01: ocean_avg_0001.nc
DEF_DIAGS - creating diagnostics file, Grid 01: ocean_dia_0001.nc
1 0 00:05:00 2.632957E-07 1.960810E+03 1.960810E+03 2.023138E+13
(091,05,01) 5.663001E-05 1.569162E-04 0.000000E+00 2.645462E-03
2 0 00:10:00 9.694084E-07 1.960809E+03 1.960809E+03 2.023140E+13
(073,09,30) 1.055442E-04 2.905283E-05 2.480221E-02 5.141087E-03
---------------------------------------------------------------------------------
----------------------------------------------------------------------------------
--------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------



634246 2202 05:50:00 8.341274E-03 1.957083E+03 1.957092E+03 2.023015E+13
(119,02,19) 4.799131E-03 4.409345E-04 1.909383E+00 1.821510E+00
634247 2202 05:55:00 8.338404E-03 1.957093E+03 1.957101E+03 2.023015E+13
(119,02,19) 6.480023E-03 2.214997E-04 2.046817E+00 1.921934E+00

Blowing-up: Saving latest model state into RESTART file

WRT_RST - wrote re-start fields (Index=2,2) in record = 0000003

Elapsed CPU time (seconds):

Node # 0 CPU: 205738.384
Node # 4 CPU: 205839.904
Node # 5 CPU: 205801.500
Node # 6 CPU: 205789.588
Node # 8 CPU: 205804.908
Node # 9 CPU: 205837.588
Node # 10 CPU: 205806.152
Node # 1 CPU: 205801.740
Node # 2 CPU: 205791.892
Node # 7 CPU: 205828.544
Node # 11 CPU: 205810.308
Node # 3 CPU: 205834.332
Total: 2469684.840

Nonlinear model elapsed time profile, Grid: 01

Allocation and array initialization .............. 1.208 ( 0.0000 %)
Ocean state initialization ....................... 0.092 ( 0.0000 %)
Reading of input data ............................ 172.196 ( 0.0070 %)
Processing of input data ......................... 22365.908 ( 0.9056 %)
Processing of output time averaged data .......... 147542.052 ( 5.9741 %)
Computation of vertical boundary conditions ...... 1301.524 ( 0.0527 %)
Computation of global information integrals ...... 15982.852 ( 0.6472 %)
Writing of output data ........................... 7550.128 ( 0.3057 %)
Model 2D kernel .................................. 1287717.468 (52.1410 %)
2D/3D coupling, vertical metrics ................. 26740.492 ( 1.0827 %)
Omega vertical velocity .......................... 18459.104 ( 0.7474 %)
Equation of state for seawater ................... 42313.560 ( 1.7133 %)
KPP vertical mixing parameterization ............. 236257.356 ( 9.5663 %)
3D equations right-side terms .................... 72107.784 ( 2.9197 %)
3D equations predictor step ...................... 228015.692 ( 9.2326 %)
Pressure gradient ................................ 27644.080 ( 1.1193 %)
Harmonic mixing of tracers, S-surfaces ........... 20354.304 ( 0.8242 %)
Harmonic stress tensor, S-surfaces ............... 25816.468 ( 1.0453 %)
Corrector time-step for 3D momentum .............. 165941.024 ( 6.7191 %)
Corrector time-step for tracers .................. 105744.456 ( 4.2817 %)
Total: 2452027.748 99.2850

Nonlinear model message Passage profile, Grid: 01

Message Passage: 2D halo exchanges ............... 387451.528 (15.6883 %)
Message Passage: 3D halo exchanges ............... 74106.316 ( 3.0006 %)
Message Passage: 4D halo exchanges ............... 75825.684 ( 3.0703 %)
Message Passage: data broadcast .................. 3591.888 ( 0.1454 %)
Message Passage: data reduction .................. 3671.600 ( 0.1487 %)
Message Passage: data gathering .................. 2352.988 ( 0.0953 %)
Message Passage: data scattering.................. 31.268 ( 0.0013 %)
Total: 547031.272 22.1498

All percentages are with respect to total time = 2469684.840


ROMS/TOMS - Output NetCDF summary for Grid 01:
number of time records written in RESTART file = 00002203
number of time records written in AVERAGE file = 00000042

Analytical header files used:

ROMS/Functionals/ana_btflux.h
ROMS/Functionals/ana_fsobc.h
ROMS/Functionals/ana_m2obc.h
ROMS/Functionals/ana_smflux.h
ROMS/Functionals/ana_srflux.h
ROMS/Functionals/ana_stflux.h

ROMS/TOMS: DONE... Monday - January 30, 2017 - 8:57:17 PM
The above run is for the northern part of bay of bengal with 1/25 degree resolution. Here model is blowing up in 7th year on 12 Feb. I am unable to understand the reason.

For the entire bay of bengal I have successfully completed the simulation with same configuration.
Attachments
basin.in
The input file of the run
(105.51 KiB) Downloaded 278 times
basin.h
activated cpp option for the run
(1.47 KiB) Downloaded 263 times

Post Reply