[2025-10-03 20:55:38,664] INFO: Adding new iteration #0.
[2025-10-03 20:55:38,673] INFO: Resuming iteration #0.
[2025-10-03 20:55:38,677] INFO: 1 new tasks have been issued.
[2025-10-03 20:55:38,678] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:38,751] INFO: The following events have been simulated before, but checkpoints are not available for this combination of `site_name` and `ranks_per_job` and wavefield compression settings. They will be run again: ['event_0', 'event_1', 'event_2', 'event_3', 'event_4']
[2025-10-03 20:55:38,782] INFO: Submitting job array with 5 jobs ...
[2025-10-03 20:55:38,908] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-10-03 20:55:38,911] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:40,912] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:41,035] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:43,037] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:46,725] INFO: Submitting job array with 5 jobs ...
[2025-10-03 20:55:46,778] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-10-03 20:55:46,779] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:48,780] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:49,145] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:51,147] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:52,166] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:54,168] INFO: Processing task `misfit_and_gradient`
[2025-10-03 20:55:55,217] INFO:
Iteration 0: Number of events: 5 chi = 0.015278809366937164 ||g|| = 0.01996766071007446
pred = --- ared = --- norm_update = --- tr_radius = ---
[2025-10-03 20:55:55,219] INFO: 1 new tasks have been issued.
[2025-10-03 20:55:55,219] INFO: Processing task `preconditioner`
[2025-10-03 20:55:55,321] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:57,333] INFO: Processing task `preconditioner`
[2025-10-03 20:55:57,505] INFO: 1 new tasks have been issued.
[2025-10-03 20:55:57,505] INFO: Processing task `misfit`
[2025-10-03 20:55:57,565] INFO: Submitting job array with 5 jobs ...
[2025-10-03 20:55:57,683] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-10-03 20:55:57,685] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:55:59,711] INFO: Processing task `misfit`
[2025-10-03 20:55:59,794] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:56:01,824] INFO: Processing task `misfit`
[2025-10-03 20:56:01,911] INFO: Some tasks of iteration #0 are still running. Please check again later.
[2025-10-03 20:56:03,945] INFO: Processing task `misfit`
[2025-10-03 20:56:04,813] INFO:
old misfit control group: 0.015278809366937162
new misfit control group: 0.005913131187795306
predicted reduction control group: -0.007919777905044612
actual reduction control group: -0.009365678179141856
5 out of 5 event(s) improved the misfit.
[2025-10-03 20:56:04,814] INFO:
Model update accepted.
[2025-10-03 20:56:04,814] INFO: 1 new tasks have been issued.
[2025-10-03 20:56:04,814] INFO: Processing task `finalize_iteration`
[2025-10-03 20:56:04,863] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00000
[2025-10-03 20:56:04,878] INFO: Freed up 613.0 KB of space.
[2025-10-03 20:56:04,879] INFO: Successfully completed iteration #0.
[2025-10-03 20:56:04,881] INFO: Adding new iteration #1.
[2025-10-03 20:56:04,885] INFO: Resuming iteration #1.
[2025-10-03 20:56:04,887] INFO: 1 new tasks have been issued.
[2025-10-03 20:56:04,887] INFO: Processing task `gradient`
[2025-10-03 20:56:05,654] INFO: Submitting job array with 5 jobs ...
[2025-10-03 20:56:05,737] INFO: Launched adjoint simulations for 5 events. Please check again to see if they are finished.
[2025-10-03 20:56:05,740] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:07,743] INFO: Processing task `gradient`
[2025-10-03 20:56:08,055] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:10,058] INFO: Processing task `gradient`
[2025-10-03 20:56:10,383] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:12,386] INFO: Processing task `gradient`
[2025-10-03 20:56:13,408] INFO:
Iteration 1: Number of events: 5 chi = 0.005913131187795306 ||g|| = 0.009340556997480898
pred = -0.007919777905044612 ared = -0.009365678179141856 norm_update = 0.8813270007035139 tr_radius = 0.8813270316788413
[2025-10-03 20:56:13,424] INFO: 1 new tasks have been issued.
[2025-10-03 20:56:13,425] INFO: Processing task `preconditioner`
[2025-10-03 20:56:13,570] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:15,605] INFO: Processing task `preconditioner`
[2025-10-03 20:56:15,650] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:17,667] INFO: Processing task `preconditioner`
[2025-10-03 20:56:17,792] INFO: 1 new tasks have been issued.
[2025-10-03 20:56:17,793] INFO: Processing task `misfit`
[2025-10-03 20:56:17,841] INFO: Submitting job array with 5 jobs ...
[2025-10-03 20:56:17,953] INFO: Launched simulations for 5 events. Please check again to see if they are finished.
[2025-10-03 20:56:17,954] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:19,990] INFO: Processing task `misfit`
[2025-10-03 20:56:20,047] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:22,076] INFO: Processing task `misfit`
[2025-10-03 20:56:22,134] INFO: Some tasks of iteration #1 are still running. Please check again later.
[2025-10-03 20:56:24,163] INFO: Processing task `misfit`
[2025-10-03 20:56:25,023] INFO:
old misfit control group: 0.005913131187795306
new misfit control group: 0.004217192287619691
predicted reduction control group: -0.0008834066261442786
actual reduction control group: -0.0016959389001756147
5 out of 5 event(s) improved the misfit.
[2025-10-03 20:56:25,024] INFO:
Model update accepted.
[2025-10-03 20:56:25,024] INFO: 1 new tasks have been issued.
[2025-10-03 20:56:25,025] INFO: Processing task `finalize_iteration`
[2025-10-03 20:56:25,096] INFO: ... searching for obsolete files in project_full_waveform_inversion/INVERSIONS/my_inversion/00001
[2025-10-03 20:56:25,269] INFO: Freed up 3.6 MB of space.
[2025-10-03 20:56:25,270] INFO: Successfully completed iteration #1.
[2025-10-03 20:56:25,274] INFO: Adding new iteration #2.