[2025-11-12 21:21:35,113] INFO: Adding new iteration #0.
[2025-11-12 21:21:35,127] INFO: Resuming iteration #0.
[2025-11-12 21:21:35,132] INFO: 1 new tasks have been issued.
[2025-11-12 21:21:35,135] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:35,272] INFO: The following events have been simulated before, but checkpoints are not available for this combination of `site_name` and `ranks_per_job` and wavefield compression settings. They will be run again: ['event_0', 'event_1', 'event_2', 'event_3', 'event_4']
[2025-11-12 21:21:35,307] INFO: Submitting job array with 5 jobs ...
[2025-11-12 21:21:35,482] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-11-12 21:21:35,490] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:37,496] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:37,707] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:39,709] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:39,858] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:41,860] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:46,339] INFO: Submitting job array with 5 jobs ...
[2025-11-12 21:21:46,442] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-11-12 21:21:46,448] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:48,450] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:49,309] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:51,311] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:51,816] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:53,818] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:54,374] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:56,377] INFO: Processing task `misfit_and_gradient`
[2025-11-12 21:21:57,822] INFO:
Iteration 0: Number of events: 5 chi = 0.015278809366937164 ||g|| = 0.01996766071007446
pred = --- ared = --- norm_update = --- tr_radius = ---
[2025-11-12 21:21:57,827] INFO: 1 new tasks have been issued.
[2025-11-12 21:21:57,828] INFO: Processing task `preconditioner`
[2025-11-12 21:21:57,973] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:21:59,997] INFO: Processing task `preconditioner`
[2025-11-12 21:22:00,164] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:00,165] INFO: Processing task `misfit`
[2025-11-12 21:22:00,224] INFO: Submitting job array with 5 jobs ...
[2025-11-12 21:22:00,409] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-11-12 21:22:00,412] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:22:02,473] INFO: Processing task `misfit`
[2025-11-12 21:22:02,620] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-11-12 21:22:04,659] INFO: Processing task `misfit`
[2025-11-12 21:22:06,682] INFO:
old misfit control group: 0.015278809366937162
new misfit control group: 0.005913131187795306
predicted reduction control group: -0.007919777905044612
actual reduction control group: -0.009365678179141856
5 out of 5 event(s) improved the misfit.
[2025-11-12 21:22:06,687] INFO:
Model update accepted.
[2025-11-12 21:22:06,692] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:06,692] INFO: Processing task `finalize_iteration`
[2025-11-12 21:22:06,767] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00000
[2025-11-12 21:22:06,793] INFO: Freed up 613.0 KB of space.
[2025-11-12 21:22:06,805] INFO: Successfully completed iteration #0.
[2025-11-12 21:22:06,812] INFO: Adding new iteration #1.
[2025-11-12 21:22:06,821] INFO: Resuming iteration #1.
[2025-11-12 21:22:06,826] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:06,834] INFO: Processing task `gradient`
[2025-11-12 21:22:07,258] INFO: Submitting job array with 5 jobs ...
[2025-11-12 21:22:07,377] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-11-12 21:22:07,381] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:09,384] INFO: Processing task `gradient`
[2025-11-12 21:22:09,799] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:11,802] INFO: Processing task `gradient`
[2025-11-12 21:22:12,250] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:14,256] INFO: Processing task `gradient`
[2025-11-12 21:22:15,353] INFO:
Iteration 1: Number of events: 5 chi = 0.005913131187795306 ||g|| = 0.009340556997480898
pred = -0.007919777905044612 ared = -0.009365678179141856 norm_update = 0.8813270007035139 tr_radius = 0.8813270316788413
[2025-11-12 21:22:15,383] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:15,385] INFO: Processing task `preconditioner`
[2025-11-12 21:22:15,634] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:17,701] INFO: Processing task `preconditioner`
[2025-11-12 21:22:17,776] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:19,808] INFO: Processing task `preconditioner`
[2025-11-12 21:22:20,053] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:20,058] INFO: Processing task `misfit`
[2025-11-12 21:22:20,141] INFO: Submitting job array with 5 jobs ...
[2025-11-12 21:22:20,382] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-11-12 21:22:20,384] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:22,431] INFO: Processing task `misfit`
[2025-11-12 21:22:22,550] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-11-12 21:22:24,598] INFO: Processing task `misfit`
[2025-11-12 21:22:26,749] INFO:
old misfit control group: 0.005913131187795306
new misfit control group: 0.004217192287619691
predicted reduction control group: -0.0008834066261442786
actual reduction control group: -0.0016959389001756147
5 out of 5 event(s) improved the misfit.
[2025-11-12 21:22:26,754] INFO:
Model update accepted.
[2025-11-12 21:22:26,754] INFO: 1 new tasks have been issued.
[2025-11-12 21:22:26,756] INFO: Processing task `finalize_iteration`
[2025-11-12 21:22:26,846] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00001
[2025-11-12 21:22:27,064] INFO: Freed up 3.6 MB of space.
[2025-11-12 21:22:27,065] INFO: Successfully completed iteration #1.
[2025-11-12 21:22:27,068] INFO: Adding new iteration #2.