ICESHELF ROMS 3.7, blow up on huge zeta after few time steps

Discussion about modeling ice with ROMS

Moderators: arango, robertson

Post Reply
Message
Author
blaupole
Posts: 5
Joined: Fri Sep 24, 2010 12:12 am
Location: Antarctic Research Centre

ICESHELF ROMS 3.7, blow up on huge zeta after few time steps

#1 Unread post by blaupole »

Hi,

I've been starting to play with ROMS 3.7 to eventually upgrade my ice shelf application from ROMS 3.4

Afte a few unsuccessful tests with small simple domains including an ice shelf I went back to the weddell test case.
The problem remains; the model blows up after a few time steps on huge zeta +/- 50m. Has anyone successfully run the weddell test case?

There are few other posts here that appear to have encountered similar problems (2013) but no replies.
One thing I noticed the Haney number seems quite big (45) but I've tried ice shelves with flat ocean bottom and tiny gradient zice (10cm/km) - to no avail. The problem of big zeta and subsequent velocities that cause the blow up remains.

any ideas?
Thank you
Stefan

Code: Select all

jes@linux-flht:~/Modeling/ROMS_projects/025/simulations/wed_test> mpirun -np 1 oceanM ocean_weddell.in 

 Model Input Parameters:  ROMS/TOMS version 3.7  
                          Sunday - November 6, 2016 -  1:31:22 AM
 -----------------------------------------------------------------------------

 Idealized Weddell Sea Shelf Application

 Operating system : Linux
 CPU/hardware     : x86_64
 Compiler system  : gfortran
 Compiler command : /usr/lib64/mpi/gcc/openmpi/bin/mpif90
 Compiler flags   : -frepack-arrays -O3 -ffast-math -ffree-form -ffree-line-length-none -ffree-form -ffree-line-length-none

 Input Script  : 

 SVN Root URL  : https://www.myroms.org/svn/src/trunk
 SVN Revision  : 820M

 Local Root    : /home/jes/Modeling/ROMS_code/ROMS_V4
 Header Dir    : /home/jes/Modeling/ROMS_projects/025/simulations/wed_test
 Header file   : weddell.h
 Analytical Dir: /home/jes/Modeling/ROMS_code/ROMS_V4/ROMS_jes/Functionals

 Resolution, Grid 01: 0300x0010x030,  Parallel Nodes:   1,  Tiling: 001x001


 Physical Parameters, Grid: 01
 =============================

       8640  ntimes            Number of timesteps for 3-D equations.
     50.000  dt                Timestep size (s) for 3-D equations.
         20  ndtfast           Number of timesteps for 2-D equations between
                                 each 3D timestep.
          1  ERstr             Starting ensemble/perturbation run number.
          1  ERend             Ending ensemble/perturbation run number.
          0  nrrec             Number of restart records to read from disk.
          T  LcycleRST         Switch to recycle time-records in restart file.
        864  nRST              Number of timesteps between the writing of data
                                 into restart fields.
          1  ninfo             Number of timesteps between print of information
                                 to standard output.
          T  ldefout           Switch to create a new output NetCDF file(s).
        864  nHIS              Number of timesteps between the writing fields
                                 into history file.
          0  nQCK              Number of timesteps between the writing fields
                                 into quicksave file.
          1  ntsAVG            Starting timestep for the accumulation of output
                                 time-averaged data.
        864  nAVG              Number of timesteps between the writing of
                                 time-averaged data into averages file.
          F  LuvSponge         Turning OFF sponge on horizontal momentum.
          F  LtracerSponge(01) Turning OFF sponge on tracer 01: temp
          F  LtracerSponge(02) Turning OFF sponge on tracer 02: salt
 1.0000E-06  Akt_bak(01)       Background vertical mixing coefficient (m2/s)
                                 for tracer 01: temp
 1.0000E-06  Akt_bak(02)       Background vertical mixing coefficient (m2/s)
                                 for tracer 02: salt
 1.0000E-05  Akv_bak           Background vertical mixing coefficient (m2/s)
                                 for momentum.
 3.0000E-04  rdrg              Linear bottom drag coefficient (m/s).
 3.0000E-03  rdrg2             Quadratic bottom drag coefficient.
 2.0000E-02  Zob               Bottom roughness (m).
          1  Vtransform        S-coordinate transformation equation.
          1  Vstretching       S-coordinate stretching function.
 3.0000E+00  theta_s           S-coordinate surface control parameter.
 0.0000E+00  theta_b           S-coordinate bottom  control parameter.
     50.000  Tcline            S-coordinate surface/bottom layer width (m) used
                                 in vertical coordinate stretching.
   1027.000  rho0              Mean density (kg/m3) for Boussinesq approximation.
      0.000  dstart            Time-stamp assigned to model initialization (days).
       0.00  time_ref          Reference time for units attribute (yyyymmdd.dd)
 0.0000E+00  Tnudg(01)         Nudging/relaxation time scale (days)
                                 for tracer 01: temp
 0.0000E+00  Tnudg(02)         Nudging/relaxation time scale (days)
                                 for tracer 02: salt
 0.0000E+00  Znudg             Nudging/relaxation time scale (days)
                                 for free-surface.
 0.0000E+00  M2nudg            Nudging/relaxation time scale (days)
                                 for 2D momentum.
 0.0000E+00  M3nudg            Nudging/relaxation time scale (days)
                                 for 3D momentum.
 0.0000E+00  obcfac            Factor between passive and active
                                 open boundary conditions.
          F  VolCons(1)        NLM western  edge boundary volume conservation.
          F  VolCons(2)        NLM southern edge boundary volume conservation.
          F  VolCons(3)        NLM eastern  edge boundary volume conservation.
          F  VolCons(4)        NLM northern edge boundary volume conservation.
     -0.278  T0                Background potential temperature (C) constant.
     34.649  S0                Background salinity (PSU) constant.
      1.000  gamma2            Slipperiness variable: free-slip (1.0) or 
                                                      no-slip (-1.0).
          F  LuvSrc            Turning OFF momentum point Sources/Sinks.
          F  LwSrc             Turning OFF volume influx point Sources/Sinks.
          F  LtracerSrc(01)    Turning OFF point Sources/Sinks on tracer 01: temp
          F  LtracerSrc(02)    Turning OFF point Sources/Sinks on tracer 02: salt
          F  LsshCLM           Turning OFF processing of SSH climatology.
          F  Lm2CLM            Turning OFF processing of 2D momentum climatology.
          F  Lm3CLM            Turning OFF processing of 3D momentum climatology.
          F  LtracerCLM(01)    Turning OFF processing of climatology tracer 01: temp
          F  LtracerCLM(02)    Turning OFF processing of climatology tracer 02: salt
          F  LnudgeM2CLM       Turning OFF nudging of 2D momentum climatology.
          F  LnudgeM3CLM       Turning OFF nudging of 3D momentum climatology.
          F  LnudgeTCLM(01)    Turning OFF nudging of climatology tracer 01: temp
          F  LnudgeTCLM(02)    Turning OFF nudging of climatology tracer 02: salt

          T  Hout(idFsur)      Write out free-surface.
          T  Hout(idUbar)      Write out 2D U-momentum component.
          T  Hout(idVbar)      Write out 2D V-momentum component.
          T  Hout(idUvel)      Write out 3D U-momentum component.
          T  Hout(idVvel)      Write out 3D V-momentum component.
          T  Hout(idWvel)      Write out W-momentum component.
          T  Hout(idOvel)      Write out omega vertical velocity.
          T  Hout(idTvar)      Write out tracer 01: temp
          T  Hout(idTvar)      Write out tracer 02: salt

          T  Aout(idFsur)      Write out averaged free-surface.
          T  Aout(idUbar)      Write out averaged 2D U-momentum component.
          T  Aout(idVbar)      Write out averaged 2D V-momentum component.
          T  Aout(idUvel)      Write out averaged 3D U-momentum component.
          T  Aout(idVvel)      Write out averaged 3D V-momentum component.
          T  Aout(idWvel)      Write out averaged W-momentum component.
          T  Aout(idOvel)      Write out averaged omega vertical velocity.
          T  Aout(idTvar)      Write out averaged tracer 01: temp
          T  Aout(idTvar)      Write out averaged tracer 02: salt

 Output/Input Files:

             Output Restart File:  /home/jes/Modeling/ROMS_projects/025/output/rst/025_rst_wed_01.nc
             Output History File:  /home/jes/Modeling/ROMS_projects/025/output/025_his_wed_01.nc
            Output Averages File:  /home/jes/Modeling/ROMS_projects/025/output/025_avg_wed_01.nc

 Tile partition information for Grid 01:  0300x0010x0030  tiling: 001x001

     tile     Istr     Iend     Jstr     Jend     Npts

        0        1      300        1       10    90000

 Tile minimum and maximum fractional coordinates for Grid 01:
   (interior points only)

     tile     Xmin     Xmax     Ymin     Ymax     grid

        0     0.50   300.50     0.50    10.50  RHO-points

        0     1.00   300.00     0.50    10.50    U-points

        0     0.50   300.50     1.00    10.00    V-points

 Maximum halo size in XI and ETA directions:

               HaloSizeI(1) =     933
               HaloSizeJ(1) =      72
                TileSide(1) =     305
                TileSize(1) =    5490


 Lateral Boundary Conditions: NLM
 ============================

 Variable               Grid  West Edge    South Edge   East Edge    North Edge
 ---------              ----  ----------   ----------   ----------   ----------

 zeta                     1   Chapman Imp  Periodic     Chapman Imp  Periodic

 ubar                     1   Flather      Periodic     Flather      Periodic

 vbar                     1   Flather      Periodic     Flather      Periodic

 u                        1   Radiation    Periodic     Radiation    Periodic

 v                        1   Radiation    Periodic     Radiation    Periodic

 temp                     1   Radiation    Periodic     Radiation    Periodic

 salt                     1   Radiation    Periodic     Radiation    Periodic

 Activated C-preprocessing Options:

 WEDDELL             Idealized Weddell Sea Shelf Application
 ANA_BSFLUX          Analytical kinematic bottom salinity flux.
 ANA_BTFLUX          Analytical kinematic bottom temperature flux.
 ANA_FSOBC           Analytical free-surface boundary conditions.
 ANA_GRID            Analytical grid set-up.
 ANA_INITIAL         Analytical initial conditions.
 ANA_M2OBC           Analytical 2D momentum boundary conditions.
 ANA_SMFLUX          Analytical kinematic surface momentum flux.
 ANA_SSFLUX          Analytical kinematic surface salinity flux.
 ANA_STFLUX          Analytical kinematic surface temperature flux.
 ASSUMED_SHAPE       Using assumed-shape arrays.
 AVERAGES            Writing out time-averaged nonlinear model fields.
 CURVGRID            Orthogonal curvilinear grid.
 DJ_GRADPS           Parabolic Splines density Jacobian (Shchepetkin, 2002).
 DOUBLE_PRECISION    Double precision arithmetic.
 ICESHELF            Include Ice Shelf Cavities.
 MPI                 MPI distributed-memory configuration.
 NONLINEAR           Nonlinear Model.
 NONLIN_EOS          Nonlinear Equation of State for seawater.
 POWER_LAW           Power-law shape time-averaging barotropic filter.
 PROFILE             Time profiling activated .
 RADIATION_2D        Use tangential phase speed in radiation conditions.
 !RST_SINGLE         Double precision fields in restart NetCDF file.
 SALINITY            Using salinity.
 SOLVE3D             Solving 3D Primitive Equations.
 SPLINES_VDIFF       Parabolic Spline Reconstruction for Vertical Diffusion.
 SPLINES_VVISC       Parabolic Spline Reconstruction for Vertical Viscosity.
 TS_A4HADVECTION     Fourth-order Akima horizontal advection of tracers.
 TS_A4VADVECTION     Fourth-order Akima vertical advection of tracers.
 UV_ADV              Advection of momentum.
 UV_COR              Coriolis term.
 UV_U3HADVECTION     Third-order upstream horizontal advection of 3D momentum.
 UV_C4VADVECTION     Fourth-order centered vertical advection of momentum.
 UV_QDRAG            Quadratic bottom stress.
 VAR_RHO_2D          Variable density barotropic mode.

 Process Information:

 Node #  0 (pid=   28748) is active.

 INITIAL: Configuring and initializing forward nonlinear model ...
 *******

 Vertical S-coordinate System, Grid 01:

 level   S-coord     Cs-curve   Z   at hmin       at hc    half way     at hmax

    30   0.0000000   0.0000000        0.000       0.000       0.000       0.000
    29  -0.0333333  -0.0099988       -4.916      -1.667     -23.039     -41.162
    28  -0.0666667  -0.0200977       -9.865      -3.333     -46.292     -82.719
    27  -0.1000000  -0.0303977      -14.879      -5.000     -69.975    -125.071
    26  -0.1333333  -0.0410019      -19.992      -6.667     -94.308    -168.624
    25  -0.1666667  -0.0520166      -25.239      -8.333    -119.519    -213.799
    24  -0.2000000  -0.0635518      -30.654     -10.000    -145.842    -261.029
    23  -0.2333333  -0.0757230      -36.277     -11.667    -173.525    -310.773
    22  -0.2666667  -0.0886521      -42.145     -13.333    -202.827    -363.509
    21  -0.3000000  -0.1024685      -48.302     -15.000    -234.026    -419.751
    20  -0.3333333  -0.1173104      -54.793     -16.667    -267.418    -480.043
    19  -0.3666667  -0.1333264      -61.664     -18.333    -303.319    -544.973
    18  -0.4000000  -0.1506768      -68.970     -20.000    -342.072    -615.173
    17  -0.4333333  -0.1695352      -76.766     -21.667    -384.048    -691.331
    16  -0.4666667  -0.1900904      -85.113     -23.333    -429.651    -774.190
    15  -0.5000000  -0.2125480      -94.078     -25.000    -479.321    -864.565
    14  -0.5333333  -0.2371329     -103.735     -26.667    -533.538    -963.342
    13  -0.5666667  -0.2640911     -114.163     -28.333    -592.828   -1071.493
    12  -0.6000000  -0.2936925     -125.450     -30.000    -657.768   -1190.085
    11  -0.6333333  -0.3262332     -137.692     -31.667    -728.990   -1320.288
    10  -0.6666667  -0.3620389     -150.996     -33.333    -807.191   -1463.387
     9  -0.7000000  -0.4014681     -165.477     -35.000    -893.138   -1620.799
     8  -0.7333333  -0.4449152     -181.264     -36.667    -987.673   -1794.082
     7  -0.7666667  -0.4928153     -198.498     -38.333   -1091.726   -1984.954
     6  -0.8000000  -0.5456476     -217.335     -40.000   -1206.322   -2195.308
     5  -0.8333333  -0.6039409     -237.947     -41.667   -1332.590   -2427.233
     4  -0.8666667  -0.6682787     -260.524     -43.333   -1471.779   -2683.034
     3  -0.9000000  -0.7393048     -285.274     -45.000   -1625.264   -2965.254
     2  -0.9333333  -0.8177301     -312.429     -46.667   -1794.565   -3276.701
     1  -0.9666667  -0.9043396     -342.244     -48.333   -1981.359   -3620.475
     0  -1.0000000  -1.0000000     -375.000     -50.000   -2187.500   -4000.000

 Time Splitting Weights for Grid 01:    ndtfast =  20    nfast =  29
 ==================================

    Primary            Secondary            Accumulated to Current Step

  1-0.0009651193358779 0.0500000000000000-0.0009651193358779 0.0500000000000000
  2-0.0013488780126037 0.0500482559667939-0.0023139973484816 0.1000482559667939
  3-0.0011514592651644 0.0501156998674241-0.0034654566136460 0.1501639558342180
  4-0.0003735756740661 0.0501732728306823-0.0038390322877122 0.2003372286649003
  5 0.0009829200513762 0.0501919516143856-0.0028561122363360 0.2505291802792859
  6 0.0029141799764308 0.0501428056118168 0.0000580677400949 0.3006719858911027
  7 0.0054132615310267 0.0499970966129953 0.0054713292711215 0.3506690825040980
  8 0.0084687837865133 0.0497264335364439 0.0139401130576348 0.4003955160405419
  9 0.0120633394191050 0.0493029943471183 0.0260034524767398 0.4496985103876601
 10 0.0161716623600090 0.0486998273761630 0.0421751148367488 0.4983983377638231
 11 0.0207585511322367 0.0478912442581626 0.0629336659689855 0.5462895820219857
 12 0.0257765478740990 0.0468533167015507 0.0887102138430846 0.5931428987235364
 13 0.0311633730493853 0.0455644893078458 0.1198735868924699 0.6387073880313822
 14 0.0368391158442262 0.0440063206553765 0.1567127027366961 0.6827137086867586
 15 0.0427031802506397 0.0421643648631652 0.1994158829873358 0.7248780735499238
 16 0.0486309868367616 0.0400292058506332 0.2480468698240974 0.7649072794005570
 17 0.0544704302037592 0.0375976565087951 0.3025173000278565 0.8025049359093521
 18 0.0600380921294286 0.0348741349986072 0.3625553921572851 0.8373790709079593
 19 0.0651152103984763 0.0318722303921357 0.4276706025557614 0.8692513013000950
 20 0.0694434033194839 0.0286164698722119 0.4971140058752453 0.8978677711723069
 21 0.0727201499285570 0.0251442997062377 0.5698341558038023 0.9230120708785446
 22 0.0745940258796570 0.0215082922098099 0.6444281816834592 0.9445203630883545
 23 0.0746596950216179 0.0177785909158270 0.7190878767050771 0.9622989540041815
 24 0.0724526566618460 0.0140456061647461 0.7915405333669231 0.9763445601689277
 25 0.0674437485167025 0.0104229733316538 0.8589842818836255 0.9867675335005816
 26 0.0590334053485720 0.0070507859058187 0.9180176872321975 0.9938183194064003
 27 0.0465456732896125 0.0040991156383901 0.9645633605218099 0.9979174350447905
 28 0.0292219798521905 0.0017718319739095 0.9937853403740003 0.9996892670187000
 29 0.0062146596259993 0.0003107329813000 0.9999999999999997 1.0000000000000000

 ndtfast, nfast =   20  29   nfast/ndtfast =  1.45000

 Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):

    1.000000000000 1.060707743385 0.530353871693 1.000000000000 1.000000000000

 Power filter parameters, Fgamma, gamma =  0.28400   0.14200

 Metrics information for Grid 01:
 ===============================

 Minimum X-grid spacing, DXmin =  4.00000000E+00 km
 Maximum X-grid spacing, DXmax =  4.00000000E+00 km
 Minimum Y-grid spacing, DYmin =  4.00000000E+00 km
 Maximum Y-grid spacing, DYmax =  4.00000000E+00 km
 Minimum Z-grid spacing, DZmin =  2.31760771E-01 m
 Maximum Z-grid spacing, DZmax =  3.79525219E+02 m

 Minimum barotropic Courant Number =  5.36099192E-02
 Maximum barotropic Courant Number =  1.75089263E-01
 Maximum Coriolis   Courant Number =  7.06854566E-03


 Basin information for Grid 01:

 Maximum grid stiffness ratios:  rx0 =   5.934862E-02 (Beckmann and Haidvogel)
                                 rx1 =   4.355871E+01 (Haney)

 Initial basin volumes: TotVolume =  9.7173030207E+13 m3
                        MinVolume =  3.7081723434E+06 m3
                        MaxVolume =  6.0724035051E+09 m3
                          Max/Min =  1.6375731608E+03

 NL ROMS/TOMS: started time-stepping: (Grid: 01 TimeSteps: 00000001 - 00008640)


   STEP   Day HH:MM:SS  KINETIC_ENRG   POTEN_ENRG    TOTAL_ENRG    NET_VOLUME
          C => (i,j,k)       Cu            Cv            Cw         Max Speed

      0     0 00:00:00  0.000000E+00  1.656305E+04  1.656305E+04  9.717303E+13
           (000,00,00)  0.000000E+00  0.000000E+00  0.000000E+00  0.000000E+00
      DEF_HIS     - creating  history      file, Grid 01: /home/jes/Modeling/ROMS_projects/025/output/025_his_wed_01.nc
      WRT_HIS     - wrote history     fields (Index=1,1) in record = 0000001
      DEF_AVG     - creating  average      file, Grid 01: /home/jes/Modeling/ROMS_projects/025/output/025_avg_wed_01.nc
      1     0 00:00:50  3.508325E-02  1.656297E+04  1.656301E+04  9.717303E+13
           (005,01,01)  7.497819E-02  2.190022E-04  0.000000E+00  6.707515E+00
      2     0 00:01:40  2.431575E-01  1.656276E+04  1.656300E+04  9.717303E+13
           (020,01,30)  3.778368E-02  3.884554E-04  6.096451E+00  3.196035E+01

 Blowing-up: Saving latest model state into  RESTART file

      WRT_RST     - wrote re-start    fields (Index=1,1) in record = 0000001

 Elapsed CPU time (seconds):

 Node   #  0 CPU:       0.143
 Total:                 0.143

 Nonlinear model elapsed time profile, Grid: 01

  Allocation and array initialization ..............         0.016  (11.1888 %)
  Ocean state initialization .......................         0.016  (11.1888 %)
  Processing of output time averaged data ..........         0.002  ( 1.3986 %)
  Computation of global information integrals ......         0.003  ( 2.0979 %)
  Writing of output data ...........................         0.017  (11.8881 %)
  Model 2D kernel ..................................         0.023  (16.0839 %)
  2D/3D coupling, vertical metrics .................         0.003  ( 2.0979 %)
  Omega vertical velocity ..........................         0.001  ( 0.6993 %)
  Equation of state for seawater ...................         0.009  ( 6.2937 %)
  3D equations right-side terms ....................         0.008  ( 5.5944 %)
  3D equations predictor step ......................         0.011  ( 7.6923 %)
  Pressure gradient ................................         0.007  ( 4.8951 %)
  Corrector time-step for 3D momentum ..............         0.011  ( 7.6923 %)
  Corrector time-step for tracers ..................         0.011  ( 7.6923 %)
                                              Total:         0.138   96.5035

 Nonlinear model message Passage profile, Grid: 01

  Message Passage: data gathering ..................         0.007  ( 4.8951 %)
                                              Total:         0.007    4.8951

 All percentages are with respect to total time =            0.143


 ROMS/TOMS - Output NetCDF summary for Grid 01:
             number of time records written in HISTORY file = 00000001
             number of time records written in RESTART file = 00000001

 Analytical header files used:

     ROMS/Functionals/ana_btflux.h
     ROMS/Functionals/ana_fsobc.h
     ROMS/Functionals/ana_grid.h
     ROMS/Functionals/ana_initial.h
     ROMS/Functionals/ana_m2obc.h
     ROMS/Functionals/ana_smflux.h
     ROMS/Functionals/ana_stflux.h

 ROMS/TOMS: DONE... Sunday - November 6, 2016 -  1:31:22 AM

User avatar
kate
Posts: 4088
Joined: Wed Jul 02, 2003 5:29 pm
Location: CFOS/UAF, USA

Re: ICESHELF ROMS 3.7, blow up on huge zeta after few time s

#2 Unread post by kate »

I haven't personally tried the ice shelves, but Mike Dinniman sent me ice shelf updates that are in my fork and not in the trunk code. Ben Galton-Fenzi's group has probably the most ice shelf experience using their own branch.

msd
Posts: 17
Joined: Fri Jun 27, 2003 10:10 pm
Location: CCPO/ODU, USA

Re: ICESHELF ROMS 3.7, blow up on huge zeta after few time s

#3 Unread post by msd »

Hi Stefan,

#ifdef ICESHELF doesn't currently work in the main ROMS trunk. The biggest issue is that the water layer depths correctly account for the presence of ice shelves in set_depth.F, but the total water depth in step2d_LF_AM3.h does not (look at how Drhs is defined in step2d_LF_AM3.h in the main trunk vs. what you were using before). This, understandably, causes bad things to happen with zeta really quickly.

If you want to upgrade to ROMS 3.7, I'd start with Kate's fork.

User avatar
kate
Posts: 4088
Joined: Wed Jul 02, 2003 5:29 pm
Location: CFOS/UAF, USA

Re: ICESHELF ROMS 3.7, blow up on huge zeta after few time s

#4 Unread post by kate »

By the way, we're talking about the code here

blaupole
Posts: 5
Joined: Fri Sep 24, 2010 12:12 am
Location: Antarctic Research Centre

Re: ICESHELF ROMS 3.7, blow up on huge zeta after few time s

#5 Unread post by blaupole »

Thank you Kate and Mike.

I got as far as 'correcting' the prsgrdXX.h and step_2d_LF..h. in the official version.

However, Ben and Dave have kindly pointed me to their ISOMIP version.

It works :)

Thank you

Post Reply