Add remaining states to the working STATES for LSF driver

This commit moves status update into its own function
(_process_job_udpate). Additionally, it adds two standalone
states FinishedJobFailure and FinishedJobSuccess.
It adds test for process_job_update that it handles all the states properly.

Use a compiled regex for matching in summary

looping over a fnmatch was simply too slow

Revert "Rename Field to FieldConfig"

This reverts commit 119c873.

Revert memory calculation change

Dodge bug when simulation_context tears down (equinor#7354)

This dodges a bug in either simulation_context or in scheduler.py that
is triggered by test_stop_sim(). This checks the behaviour when all
realizations are killed, and there is a bug that can cause this process
to hang while trying to kill.

This commit will rerun the test in case of failure, and will make the CI
work while the underlying bug is being prioritized.

Fix calculation of batch size

* Fix calculation of batch size

Need to take into account number of parameters.

* Use float32 when calculating batch size

Migrate empty summary

Remove ValueError causing issue with storage v4

Pin pytest due to flaky

box/flaky#198

Pin pytest due to flaky (equinor#7337)

box/flaky#198

Co-authored-by: Yngve S. Kristiansen <[email protected]>