@tkuhn perhaps, I should do a few #nanopub onboarding sessions embedded with my planned #Snakemake Hackathon and the Snakemake implementation for nanopubs in a workshop (for which I still need to do some work) next year.

I'm not sure, I followed you with your remark - is this better? https://w3id.org/np/RAADhF-xHWOeATa1pKZelZ2Jwbpjxrxn8Md-yKVRxdHho

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.3!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.3 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* ci slurm check: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/388

@Dutch_Reproducibility_Network

In fact, I am a #Snakemake co-maintainer and teacher. I was not aware of WorkflowHub - and that was an omission on my part. We actually support and favour this kind of registration: https://snakemake.readthedocs.io/en/stable/snakefiles/deployment.html#uploading-workflows-to-workflowhub

In my original post, I also neglected to mention the integration of WorkflowHub with #RO-Crate and in turn, the integration of RO-Crates with nanopubs. I am actively working on a better support for #nanopub and RO-Crates with @fbartusch. The question, how I teach that stands: The #HPC world (at least my bubble) is not really supportive for #ReproducibleComputing . All #OpenScience shenanigans are frowned upon. And PIs in my vicinity are still on this level: https://phdcomics.com/comics/archive.php?comicid=1531 - so, how do we educate the educators?

BEEP, BEEP - I am your friendly #Snakemake release announcement bot.

There is a new release of Snakemake. Its version now is 9.14.4!

Give us some time, and you will automatically find it on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainer here on Mastodon!
@johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake/issues.

See https://github.com/snakemake/snakemake/releases/tag/v9.14.4 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* fix follow-up issue with group job handling when retrieving storage: https://github.com/snakemake/snakemake/issues/3871

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.2!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.2 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* partition cluster selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/385

BEEP, BEEP - I am your friendly #Snakemake release announcement bot.

There is a new release of Snakemake. Its version now is 9.14.3!

Give us some time, and you will automatically find it on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainer here on Mastodon!
@johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake/issues.

See https://github.com/snakemake/snakemake/releases/tag/v9.14.3 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* ensure that queue input jobs wait if the queue is still empty upon job creation: https://github.com/snakemake/snakemake/issues/3866
* fix issues with cyclic dependencies when using the update and before_update flag: https://github.com/snakemake/snakemake/issues/3857

BEEP, BEEP - I am your friendly #Snakemake release announcement bot.

There is a new release of Snakemake. Its version now is 9.14.2!

Give us some time, and you will automatically find it on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainer here on Mastodon!
@johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake/issues.

See https://github.com/snakemake/snakemake/releases/tag/v9.14.2 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* correctly handle groups when retrieving storage input: https://github.com/snakemake/snakemake/issues/3861

BEEP, BEEP - I am your friendly #Snakemake release announcement bot.

There is a new release of Snakemake. Its version now is 9.14.1!

Give us some time, and you will automatically find it on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainer here on Mastodon!
@johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake/issues.

See https://github.com/snakemake/snakemake/releases/tag/v9.14.1 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* always raise FileNotFoundError in case of missing files in resource expressions that do size evaluations: https://github.com/snakemake/snakemake/issues/3854
* ensure that spawned jobs do not handle retries themselves. The main process does that.: https://github.com/snakemake/snakemake/issues/3855

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.1!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.1 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* validator check for integers was broken.: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/381

BEEP, BEEP - I am your friendly #Snakemake release announcement bot.

There is a new release of Snakemake. Its version now is 9.14.0!

Give us some time, and you will automatically find it on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainer here on Mastodon!
@johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake/issues.

See https://github.com/snakemake/snakemake/releases/tag/v9.14.0 for details. Here is the header of the changelog:
𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬

* Support Hy in script directive: https://github.com/snakemake/snakemake/issues/3824

𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* Add support for pathlib in `notebook` field: https://github.com/snakemake/snakemake/issues/3811
* Addressed race condition in workdir_handler.py: https://github.com/snakemake/snakemake/issues/3844
* cleanup update-marked output files of failed jobs if there was no backup to restore them: https://github.com/snakemake/snakemake/issues/3843
* correct Windows callable path handling: https://github.com/snakemake/snakemake/issues/3832
* expand env vars on resources: https://github.com/snakemake/snakemake/issues/3823
* fix backup for output marked by `update`: https://github.com/snakemake/snakemake/issues/3839
* Minor fixes/additions to logging module.: https://github.com/snakemake/snakemake/issues/3802
* mount local storage prefix into containers: https://github.com/snakemake/snakemake/issues/3840
* proper...

#Snakemake 9.14 is released. It integrates with yet another scripting language ( #hy, adding to the already existing #python, #r, #rust, #bash, and #julia support). Further it offers a massively improved local storage footprint. Many thanks to our awesome community! https://snakemake.github.io

*sigh*

A totally normal Thanksgiving thought while I'm still in wait mode for putting the turkey on the grill is that I need to update some (all) of my #Docker images I use for #HPC analysis with #snakemake.

Somehow I didn't install sleuth correctly on my bulk #RNASeq R image. Which reminded me that the images are on #Ubuntu 20. I need to just jump to 24 LTS. And automate my building and pushing. It's all manual now.

😠

RE: https://fediscience.org/@snakemake/115611862667755622

Now, this is huge!

Thanks to a contribution from Cade Mirchandani (Santa Cruz, CA), whom I met at this year's #SnakemakeHackathon users can now supply a partition profile. So, instead of wrangling #SLURM partition information into a workflow profile (indicated with --workflow-profile), we can now have a global file to contain this information.

I added a time conversion function, such that the SLURM time format is obeyed, too.

There are several other development needs, before we continue in this direction (e.g. parsing SLURM partition information directly). But a task to be done is summing this up for non-users, e.g. administrators, is due too.

In any case, I think this merits a new major version.

#Snakemake #HPC #ReproducibleComputing

Beep, Beep - I am your friendly #Snakemake release announcement bot.

There is a new release of the Snakemake executor for #SLURM on #HPC systems. Its version now is 2.0.0!

Give us some time, and you will automatically find the plugin on #Bioconda and #Pypi.

If you want to discuss the release, you will find the maintainers here on Mastodon!
@rupdecat and @johanneskoester

If you discover any issues, please report them on https://github.com/snakemake/snakemake-executor-plugin-slurm/issues.

See https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v2.0.0 for details. Here is the header of the changelog:

𝑅𝑒𝑙𝑒𝑎𝑠𝑒 𝑁𝑜𝑡𝑒𝑠 (𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑦 𝑎𝑏𝑏𝑟𝑖𝑔𝑒𝑑):
⚠ 𝐁𝐑𝐄𝐀𝐊𝐈𝐍𝐆 𝐂𝐇𝐀𝐍𝐆𝐄𝐒

* proposal for dynamic partition selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/321

𝐅𝐞𝐚𝐭𝐮𝐫𝐞𝐬

* partition time handling: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/378
* proposal for dynamic partition selection: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/321

𝐁𝐮𝐠 𝐅𝐢𝐱𝐞𝐬

* naming SLURM logs, SLURM logs not just "log files": https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/372

𝐃𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧

* Replace incorrect Markdown with a blockquote: https://github.com/snakemake/snakemake-executor-plugin-slurm/issues/377

rOpenSci will be participating in @latinr_conf!

Here is the key data for your participation:

🎙️ Keynotes

- Heather Turner: Lowering Barriers to Contributing to R.

- Stephanie Zimmer: Transforming a team to open-source first.

- TRACE-LAC Team. Lo invisible del código abierto: Lecciones desde el proyecto TRACE-LAC / Epiverso para conectar el desarrollo de software con la salud pública

🎓 Tutorials by rOpenSci members:

📌 ¡Miércoles, Git! Manejo de errores en Git y no morir en el intento — @maelle , @yabellini. Registration: https://www.eventbrite.cl/e/miercoles-git-manejo-de-errores-en-git-y-no-morir-en-el-intento-tickets-1937068908249

📌 Introducción a #Tidymodels — Francisco Cardozo & Edgar Ruiz. Registration: https://www.eventbrite.cl/e/introducion-a-tidymodels-tickets-1962543491413

📌 Automatización de workflows en R y Python con #targets y #Snakemake — Diana García. Registration: https://www.eventbrite.cl/e/automatizacion-de-workflows-en-r-y-python-con-targets-y-snakemake-tickets-1936131664929

📌 ¿Qué historia vas a contar hoy Herramientas para una comunicación eficaz — Alejandra Bellini. Registration: https://www.eventbrite.cl/e/que-historia-vas-a-contar-hoy-herramientas-para-una-comunicacion-eficaz-tickets-1891497192019

📌 Coding with #AI in RStudio — Juan Cruz Rodríguez & @LuisDVerde. Registration: https://www.eventbrite.cl/e/coding-with-ai-in-rstudio-tickets-1962817615325

List with all tutorials here: https://latinr.org/en/

#RStats #RStatsES #openScience #RSE #OpenData #FOSS #DataScience #Analytics

1/2

@pjacock @egonw @yokofakun

Perhaps a missing postfix?

Anyway, the rolling #Snakemake paper received a non-functional DOI, which was corrected several weeks after the update.

So, perhaps a mix of both? Some email snafu and new DOIs being registered?

@davelunt

Oh, I am dealing with plenty of quirky programs myself. And I hate it. 😉

In the off-chance that this might be new: there is the #Snakemake wrapper project, with plenty of wrappers to make a programmer's life easier. See https://snakemake-wrappers.readthedocs.io/en/stable/

We’ve added a new Snakemake meta-wrapper for creating standalone variant reports:
🔗 https://snakemake-wrappers.readthedocs.io/en/stable/meta-wrappers/bio/alignoth_report.html
It combines Datavzrd for an interactive overview table with Alignoth for read pileup plots — all linked together in one portable HTML report.

Check out our demo hosted on GitHub pages: https://alignoth.github.io/alignoth-example-report/variants/index_1.html
Props to my colleague Felix who worked with me on this over the last few weeks in the @johanneskoester lab.
#snakemake #bioinformatics #genomics

This took a while. After the new version of the Snakemake paper (a rolling paper on F1000) came out, the DOI now is "working" 🥳 :

https://doi.org/10.12688/f1000research.29032.3

From my point of view, it particularly describes the working with various #HPC batch systems. And: Development did not cease. If you want to follow our announcement bot for updates: @snakemake

#Snakemake #ReproducibleComputing #DataAnalysis #OpenScience #WorkflowManagement

@davelunt just stumbled over the #Snakemake hashtag. Snakemake has the directory() function just for that purpose: https://snakemake.readthedocs.io/en/stable/snakefiles/rules.html#directories-as-outputs