Skip to content

Concurrency execution support and tunnings in video-audit command #208

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 10 commits into from
Dec 1, 2025
Merged

Concurrency execution support and tunnings in video-audit command #208

merged 10 commits into from
Dec 1, 2025

Conversation

@vmdocua
Copy link
Collaborator

@vmdocua vmdocua commented Nov 27, 2025 •
edited
Loading

Provides tunnings of video-audit command necessary to work with /data/reprostim dataset @ typhon and automated data processing with cron jobs in concurrent execution environment.

Tasks:

  • Add multiple PATH arguments support (1 or more) in video-audit command.
  • Fix video-audit help default.
  • Provide separated update timestamp info for extrenal tools like detect-nosignal or qr-parse.
  • Add lock protection for videos.tsv file (load/update/save cycles) needed in concurrent environment with long-run video-audit cron jobs.
  • Implement automatic videos.tsv merge logic to selectively keep the latest processed data.

@vmdocua vmdocua self-assigned this Nov 27, 2025
@vmdocua vmdocua added documentation Changes only affect the documentation enhancement New feature or request patch Increment the patch version when merged labels Nov 27, 2025
@vmdocua
Add multiple PATH arguments support (1or more) in video-audit command, …
b549dff 
…#208.
@vmdocua
Add explicit filelock dependency, #208.
d951e1e
@vmdocua
Provides videos.tsv lock protection against concurrent read/wite oper…
ad02ecc 
…ations, protects file integrity, but didn't support automatic data merge atm, #208.
@vmdocua
Add placeholder for video-audit records merge functionality, #208.
15cd5be
@vmdocua
Merge logic notes and codespell fixes, #208.
fa0e53e
@vmdocua
Implement merge logic for force and full modes, #208.
ca2d971
@vmdocua
Skip any merge logic when videos.tsv file content was not updated dur…
c521bb2 
…ing command run, #208.
@vmdocua
Add additional no_signal_updated_on and qr_updated_on columns to allo…
35c10ee 
…w merge of external tools metadata. Also removed updated_by column as was discussed before, #208.
@vmdocua
Implement timestamp comparison and merging logic for VaRecord objects…
32970a2 
… to enhance record merging functionality, #208.
@vmdocua vmdocua changed the title Misc video-audit command tunnings Concurrency execution support and tunnings in video-audit command Nov 30, 2025
@vmdocua vmdocua added dependencies Update one or more dependencies version release Create a release when this pr is merged labels Nov 30, 2025
@vmdocua vmdocua marked this pull request as ready for review December 1, 2025 09:24
@vmdocua vmdocua merged commit 55918a0 into master Dec 1, 2025
10 checks passed
@vmdocua vmdocua deleted the enh-video-audit-tune branch December 1, 2025 09:25
@github-actions
Copy link

github-actions bot commented Dec 1, 2025

🚀 PR was released in 0.7.21 🚀

@github-actions github-actions bot added the released This issue/pull request has been released. label Dec 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@vmdocua vmdocua

Labels

dependencies Update one or more dependencies version documentation Changes only affect the documentation enhancement New feature or request patch Increment the patch version when merged release Create a release when this pr is merged released This issue/pull request has been released.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmdocua