[2025-07-23 21:12:13,468] INFO: Adding new iteration #0.
[2025-07-23 21:12:13,473] INFO: Resuming iteration #0.
[2025-07-23 21:12:13,474] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:13,474] INFO: Processing task `misfit_and_gradient`
[2025-07-23 21:12:13,530] INFO: The following events have been simulated before, but checkpoints are not available for this combination of `site_name` and `ranks_per_job` and wavefield compression settings. They will be run again: ['event_0', 'event_1', 'event_2', 'event_3', 'event_4']
[2025-07-23 21:12:13,550] INFO: Submitting job array with 5 jobs ...
[2025-07-23 21:12:13,633] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-07-23 21:12:13,634] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:15,635] INFO: Processing task `misfit_and_gradient`
[2025-07-23 21:12:15,737] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:17,738] INFO: Processing task `misfit_and_gradient`
[2025-07-23 21:12:20,307] INFO: Submitting job array with 5 jobs ...
[2025-07-23 21:12:20,353] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-07-23 21:12:20,354] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:22,355] INFO: Processing task `misfit_and_gradient`
[2025-07-23 21:12:22,628] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:24,630] INFO: Processing task `misfit_and_gradient`
[2025-07-23 21:12:25,236] INFO:
Iteration 0: Number of events: 5 chi = 0.015278803721797369 ||g|| = 0.01996765797717116
pred = --- ared = --- norm_update = --- tr_radius = ---
[2025-07-23 21:12:25,236] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:25,237] INFO: Processing task `preconditioner`
[2025-07-23 21:12:25,297] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:27,306] INFO: Processing task `preconditioner`
[2025-07-23 21:12:27,427] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:27,427] INFO: Processing task `misfit`
[2025-07-23 21:12:27,467] INFO: Submitting job array with 5 jobs ...
[2025-07-23 21:12:27,550] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-07-23 21:12:27,551] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:29,566] INFO: Processing task `misfit`
[2025-07-23 21:12:29,627] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-07-23 21:12:31,646] INFO: Processing task `misfit`
[2025-07-23 21:12:32,499] INFO:
old misfit control group: 0.015278803721797369
new misfit control group: 0.005913133008434076
predicted reduction control group: -0.007919783452962292
actual reduction control group: -0.009365670713363293
5 out of 5 event(s) improved the misfit.
[2025-07-23 21:12:32,500] INFO:
Model update accepted.
[2025-07-23 21:12:32,500] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:32,500] INFO: Processing task `finalize_iteration`
[2025-07-23 21:12:32,533] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00000
[2025-07-23 21:12:32,541] INFO: Freed up 613.0 KB of space.
[2025-07-23 21:12:32,541] INFO: Successfully completed iteration #0.
[2025-07-23 21:12:32,542] INFO: Adding new iteration #1.
[2025-07-23 21:12:32,546] INFO: Resuming iteration #1.
[2025-07-23 21:12:32,546] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:32,547] INFO: Processing task `gradient`
[2025-07-23 21:12:32,725] INFO: Submitting job array with 5 jobs ...
[2025-07-23 21:12:32,772] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-07-23 21:12:32,773] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-07-23 21:12:34,774] INFO: Processing task `gradient`
[2025-07-23 21:12:34,964] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-07-23 21:12:36,965] INFO: Processing task `gradient`
[2025-07-23 21:12:37,463] INFO:
Iteration 1: Number of events: 5 chi = 0.005913133008434076 ||g|| = 0.00934055110656381
pred = -0.007919783452962292 ared = -0.009365670713363293 norm_update = 0.8813276753908115 tr_radius = 0.8813277085125916
[2025-07-23 21:12:37,472] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:37,472] INFO: Processing task `preconditioner`
[2025-07-23 21:12:37,542] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-07-23 21:12:39,560] INFO: Processing task `preconditioner`
[2025-07-23 21:12:39,686] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:39,686] INFO: Processing task `misfit`
[2025-07-23 21:12:39,725] INFO: Submitting job array with 5 jobs ...
[2025-07-23 21:12:39,809] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-07-23 21:12:39,810] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-07-23 21:12:41,836] INFO: Processing task `misfit`
[2025-07-23 21:12:41,899] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-07-23 21:12:43,928] INFO: Processing task `misfit`
[2025-07-23 21:12:44,578] INFO:
old misfit control group: 0.005913133008434076
new misfit control group: 0.004217191511153765
predicted reduction control group: -0.0008834076033963356
actual reduction control group: -0.001695941497280311
5 out of 5 event(s) improved the misfit.
[2025-07-23 21:12:44,579] INFO:
Model update accepted.
[2025-07-23 21:12:44,579] INFO: 1 new tasks have been issued.
[2025-07-23 21:12:44,579] INFO: Processing task `finalize_iteration`
[2025-07-23 21:12:44,627] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00001
[2025-07-23 21:12:44,734] INFO: Freed up 3.6 MB of space.
[2025-07-23 21:12:44,735] INFO: Successfully completed iteration #1.
[2025-07-23 21:12:44,736] INFO: Adding new iteration #2.