------------------------------------------------------ Job is running on node compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 ------------------------------------------------------ PBS: qsub is running on coma.hpc1.cs.cmu.edu PBS: originating queue is physics PBS: executing queue is physics PBS: working directory is /physics2/vat/bluetide/jobfiles PBS: execution mode is PBS_BATCH PBS: job identifier is 637163.coma.hpc1.cs.cmu.edu PBS: job name is job_dmo.sh PBS: node file is /var/spool/torque/aux//637163.coma.hpc1.cs.cmu.edu PBS: current home directory is /home/vat PBS: PATH = /home/vat/anaconda2/bin:/home/vat/anaconda2/bin:/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/opt/dell/srvadmin/bin:/home/vat/bin:/home/vat/physics/vatcosmo/Mathematica/9.0/Executables/ ------------------------------------------------------ server is coma.hpc1.cs.cmu.edu workdir is /scratch/PBS_637163.coma.hpc1.cs.cmu.edu permdir is /home/vat/physics/vatcosmo servpermdir is coma.hpc1.cs.cmu.edu:/home/vat/physics/vatcosmo ------------------------------------------------------ Job is running on node compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-38 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-36 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-34 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-2-16 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-18 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-4 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-3 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 compute-1-7-2 ------------------------------------------------------ Transferring files from server to compute node PBS: working directory is /physics2/vat/bluetide/jobfiles Writing files in node directory /scratch/PBS_637163.coma.hpc1.cs.cmu.edu from /physics2/vat/bluetide/jobfiles and /home/vat/physics/vatcosmo /home/vat /physics2/vat/bluetide/jobfiles This is MP-Gadget, version 5.0.2a5febcd5d-dirty. Running on 128 MPI Ranks. 16 OpenMP Threads. Code was compiled with settings: mpiicc -openmp -O0 -g -DDENSITY_INDEPENDENT_SPH -DPETAPM_ORDER=1 -DOPENMP_USE_SPINLOCK -DUNEQUALSOFTENINGS -DSPH_GRAD_RHO -DTOPNODEFACTOR=5.0 -DMYSORT -DSFR -DMETALS -DWINDS -DBLACK_HOLES -DNO_ISEND_IRECV_IN_DOMAIN -DINHOMOG_GASDISTR_HINT Size of particle structure 208 [bytes] Size of blackhole structure 200 [bytes] Size of sph particle structure 216 [bytes] Triggering Action on `OutputList` Triggering Action on `StarformationCriterion` Triggering Action on `BlackHoleFeedbackMethod` [ 000000.00 ] Task 0: ----------- Running with Parameters ---------- InitCondFile /nfs/nas-0-1/vat/bluetide/ICDMO-400MPC/IC # Path to the Initial Condition File OutputDir /nfs/nas-0-1/vat/bluetide/RUNDMO-400MPC/ # Prefix to the output files TreeCoolFile # Path to the Cooling Table MetalCoolFile # Path to the Metal Cooling Table. Refer to cooling.c UVFluctuationFile # Path to the UVFluctation Table. Refer to cooling.c. DensityKernelType quintic # SnapshotFileBase snapshot # EnergyFile energy.txt # CpuFile cpu.txt # InfoFile info.txt # OutputList 0.01 # List of output times Omega0 0.2814 # CMBTemperature 2.7255 # Present-day CMB temperature in Kelvin, default from Fixsen 2009; affects background if RadiationOn is set. OmegaBaryon 0.0464 # OmegaLambda 0.7186 # HubbleParam 0.697 # BoxSize 400000 # MaxMemSizePerCore 1200 # CpuTimeBetRestartFile 9000 # TimeBegin 0.00625 # TimeMax 1 # TimeLimitCPU 86400 # DomainOverDecompositionFactor 8 # Number of sub domains on a MPI rank DomainReportSpeedfac 0 # Print speed factors in Domain, for profiling. TreeDomainUpdateFrequency 0.025 # ErrTolTheta 0.5 # TypeOfOpeningCriterion 1 # ErrTolIntAccuracy 0.02 # ErrTolForceAcc 0.005 # Nmesh 256 # MinGasHsmlFractional 0 # MaxGasVel 300000 # TypeOfTimestepCriterion 0 # Magic numbers! MaxSizeTimestep 0.1 # MinSizeTimestep 0 # MaxRMSDisplacementFac 0.2 # ArtBulkViscConst 0.75 # CourantFac 0.15 # DensityResolutionEta 1 # Resolution eta factor (See Price 2008) 1 = 33 for Cubic Spline DensityContrastLimit 100 # Max contrast for hydro force calculation MaxNumNgbDeviation 2 # HydroCostFactor 1 # Cost factor of hydro calculation, default to 1. NumPartPerFile 134217728 # number of particles per file NumWriters 128 # Number of concurrent writer processes. 0 implies Number of Tasks EnableAggregatedIO 1 # Use the Aggregated IO policy for small data set (Experimental). CoolingOn 0 # HydroOn 0 # StarformationOn 0 # RadiationOn 0 # Include radiation density in the background evolution. FastParticleType 2 # Particles of this type will not decrease the timestep. Default neutrinos. NoTreeType 2 # Particles of this type will not produce tree forces. Default neutrinos. SofteningHalo 1.85 # SofteningDisk 0 # SofteningBulge 0 # SofteningGas 1.85 # SofteningStars 1.85 # SofteningBndry 1.85 # SofteningHaloMaxPhys 1.85 # SofteningDiskMaxPhys 0 # SofteningBulgeMaxPhys 0 # SofteningGasMaxPhys 1.85 # SofteningStarsMaxPhys 1.85 # SofteningBndryMaxPhys 1.85 # BufferSize 100 # PartAllocFactor 2 # TopNodeAllocFactor 0.5 # InitGasTemp 580 # MinGasTemp 5 # RestartFromBlueTidesPhaseI 0 # The Restart snapshot is BlueTidesPhaseI, some fields are missing. SnapshotWithFOF 1 # Enable Friends-of-Friends halo finder. FOFHaloLinkingLength 0.2 # Linking length for Friends of Friends halos. FOFHaloMinLength 32 # MinFoFMassForNewSeed 5 # Minimal Mass for seeding tracer particles TimeBetweenSeedingSearch 1.05 # Time Between Seeding Attempts: default to a a large value, meaning never. BlackHoleOn 0 # Enable Blackhole BlackHoleAccretionFactor 100 # BlackHoleEddingtonFactor 3 # SeedBlackHoleMass 5e-05 # BlackHoleNgbFactor 2 # BlackHoleMaxAccretionRadius 99999 # BlackHoleFeedbackFactor 0.05 # BlackHoleFeedbackRadius 0 # BlackHoleFeedbackRadiusMaxPhys 0 # BlackHoleFeedbackMethod mass | spline # StarformationCriterion density | h2 # CritOverDensity 57.7 # CritPhysDensity 0 # FactorSN 0.1 # FactorEVP 1000 # TempSupernova 1e+08 # TempClouds 1000 # MaxSfrTimescale 1.5 # WindModel decouple | halo | ofjt10 | nowind # WindEfficiency 2 # WindEnergyFraction 1 # WindSigma0 353 # WindSpeedFactor 3.7 # WindFreeTravelLength 20 # WindFreeTravelDensFac 0.1 # QuickLymanAlphaProbability 0 # [ 000000.00 ] Task 0: ---------------------------------------------- [ 000000.00 ] Task 0: StarformationOn is disabled! [ 000000.00 ] Task 0: The Density Kernel type is QuinticSpline [ 000000.00 ] Task 0: The Density resolution is 1 * mean separation, or 113 neighbours [ 000000.00 ] Task 0: Reference Windspeed: 1306.1 [ 000000.00 ] Task 0: Hubble (internal units) = 0.1 [ 000000.00 ] Task 0: G (internal units) = 43007.1 [ 000000.00 ] Task 0: UnitMass_in_g = 1.989e+43 [ 000000.00 ] Task 0: UnitTime_in_s = 3.08568e+16 [ 000000.00 ] Task 0: UnitVelocity_in_cm_per_s = 100000 [ 000000.00 ] Task 0: UnitDensity_in_cgs = 6.76991e-22 [ 000000.00 ] Task 0: UnitEnergy_in_cgs = 1.989e+53 [ 000000.00 ] Task 0: Photon density OmegaG = 5.0888e-05 [ 000000.00 ] Task 0: Massless Neutrino density OmegaNu0 = 3.51282e-05 [ 000000.00 ] Task 0: Curvature density OmegaK = 0 [ 000000.00 ] Task 0: [ 000000.08 ] Aggregated IO is enabled [ 000000.20 ] Using 2D Task mesh 8 x 16 [ 000001.71 ] Reading snapshot /nfs/nas-0-1/vat/bluetide/ICDMO-400MPC/IC [ 000001.85 ] Total number of particles: 000000000010648000 [ 000001.87 ] Total number of gas particles: 000000000000000000 [ 000001.89 ] Total number of star particles: 000000000000000000 [ 000001.91 ] Total number of bh particles: 000000000000000000 [ 000001.99 ] Allocated 33.0027 MByte for particle storage. [ 000001.99 ] Allocated 0 MByte for storage of SPH data. [ 000001.99 ] Allocated 0 MByte for storage of BH data. [ 000002.35 ] Reading Block 1/Position ############ WARNING: EARLY TERMINATION ############# Transferring files from compute nodes to server Writing files in permanent directory /home/vat/physics/vatcosmo Final files in permanent data directory: ############ WARNING: EARLY TERMINATION ############# Transferring files from compute nodes to server Writing files in permanent directory /home/vat/physics/vatcosmo Final files in permanent data directory: Transferring files from compute nodes to server Writing files in permanent directory /home/vat/physics/vatcosmo Final files in permanent data directory: