Merge pull request #62 from IntersectMBO/better_log_processing
refactor(sync_tests): improve log processing efficiency
refactor(sync_tests): improve log processing efficiency
- Refactored `get_data_from_logs` to handle large logs efficiently - Added chunked reading of log files to reduce memory usage - Improved regex patterns for extracting log data - Simplified CPU load percentage calculation - Merged data into `logs_details_dict` with better timestamp handling
- Refactored `get_data_from_logs` to handle large logs efficiently - Added chunked reading of log files to reduce memory usage - Improved regex patterns for extracting log data - Simplified CPU load percentage calculation - Merged data into `logs_details_dict` with better timestamp handling
- Refactored `get_data_from_logs` to handle large logs efficiently - Added chunked reading of log files to reduce memory usage - Improved regex patterns for extracting log data - Simplified CPU load percentage calculation - Merged data into `logs_details_dict` with better timestamp handling
- Refactored `get_data_from_logs` to handle large logs efficiently - Added chunked reading of log files to reduce memory usage - Improved regex patterns for extracting log data - Simplified CPU load percentage calculation - Merged data into `logs_details_dict` with better timestamp handling
chore(deps): bump buildkite/trigger-pipeline-action from 1.5.0 to 2.3.0
Fix typo in node_sync_test_genesis.yaml workflow
Update buildkite timeout for node sync tests
Update name of genesis node sync tests workflow
Bumps [buildkite/trigger-pipeline-action](https://github.com/buildkite/trigger-pipeline-action) from 1.5.0 to 2.3.0. - [Release notes](https://github.com/buildkite/trigger-pipeline-action/releases) - [Commits](https://github.com/buildkite/trigger-pipeline-action/compare/v1.5.0...v2.3.0) --- updated-dependencies: - dependency-name: buildkite/trigger-pipeline-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]>
Update name of genesis node sync tests workflow
Enable Genesis mode - transitory approach
Node sync test refactor phase 1
- Added logging configuration to multiple test files - Replaced direct logging calls with LOGGER in utility modules - Ensured consistent logging format across the codebase
Replaced all instances of `utils` module with `helpers` module in `node_sync_test.py`. This change ensures consistency and improves code readability by using a single module for helper functions.
- Replaced `chdir` calls with `temporary_chdir` context manager - Updated functions to use `pl.Path` for path manipulations - Improved readability and maintainability of the code
Refactored node sync test functions to remove the global `args` variable. Functions now accept environment as a parameter. Added logging for better debugging and tracking. Updated function names and signatures to improve clarity and consistency. Adjusted main function to initialize logging and parse arguments separately.