J-M’s ‘lab notebook’

Categories

All (31)

(1)

Azure (2)

C++ (9)

Debian (1)

Electron (1)

Fortran (2)

HydroMT (1)

IDE (2)

Microsoft (1)

MkDocs (1)

NLP (3)

Notebook (2)

Python (5)

Python packaging (1)

R (1)

R packaging (1)

Rcpp (1)

Security (1)

VCPP (2)

WASI (1)

WASM (1)

WebAssembly (1)

WiX (4)

Windows (1)

code generation (3)

conda (3)

conda-channel (1)

conda-forge (2)

d3.js (1)

debugging (1)

devops (1)

documentation (1)

emscripten (1)

f90wrap (2)

git (2)

hugging-face (3)

hydrology (1)

hydstra (1)

installers (4)

interop (1)

jupyter (1)

kvm (1)

lithology (3)

memory (1)

nbdev (1)

packaging (2)

performance (1)

practices (1)

python (5)

qemu (1)

recipes (4)

reproducibility (1)

runtime (1)

safety (1)

sankey (1)

template (1)

vagrant (1)

versioning (1)

Python packaging

python

packaging

template

practices

Take stock of the python packaging landscape to refresh practices

Wrapping air2stream to access it from Python - part 2

python

f90wrap

code generation

Fortran

Python wrapper for the the Fortran program air2stream using f90wrap

Reproducing past results in scientific computing

reproducibility

versioning

git

Computational reproducibility is hard work, even when you’ve done a good job to prepare for it

Wrapping air2stream to access it from Python - part 1

python

f90wrap

code generation

Fortran

Python wrapper for the the Fortran program air2stream using f90wrap

Debugging Rcpp and C++ code from visual studio code

debugging

R

Rcpp

C++

Debugging Rcpp and C++ code from visual studio code

Producing Sankey diagrams from Python

python

d3.js

sankey

Producing Sankey diagrams from Python

Exploring HydroMT - part 1

HydroMT

python

hydrology

Exploring HydroMT - part 1. Going through a ‘getting started’ example, and exploring from here on.

Windows installer with WiX 4 - part 4

WiX

installers

Building a Windows installer with WiX 4 - part 4

Windows installer with WiX 4 - part 3

WiX

installers

Building a Windows installer with WiX 4 - part 3

Windows installer with WiX 4 - part 2

WiX

installers

Building a Windows installer with WiX 4 - part 2

Windows installer with WiX 4 - part 1

WiX

installers

Building a Windows installer with WiX 4 - part 1

C++ static code analysis

C++

memory

safety

C++ static code analysis

Running a Windows VM with Vagrant on Linux

kvm

vagrant

qemu

Running a Windows VM with Vagrant on Linux, trying via Qemu and VirtualBox

Electron+python multi-os installers

Azure

Electron

packaging

Building multiplatform installers for an electron application with an embedded python server

Custom rules for gitleaks

Security

git

Adding rules to a gitleaks configuration to scan git repo for low-medium sensitivity information

Using nbdev on Windows - part 2

Python

Notebook

IDE

nbdev

Getting through a tutorial to test the operation of nbdev on Windows native

Using nbdev on Windows

Python

Notebook

IDE

Testing setting up and using nbdev on Windows

Compiling C++ libraries to WebAssembly - Part 1

C++

WASM

WebAssembly

emscripten

WASI

First attempt at compiling a streamflow forecasting software stack to WebAssembly

Generate programming language bindings to a C API

code generation

interop

C++

Python

Generate language binging for Python, R and other wrappers on top of a C API

Presenting doxygen C++ API documentation via MkDocs with doxybook2

documentation

C++

Python

MkDocs

Convert doxygen C++ API documentation to Markdown with doxybook2, to generate a gorgeous site with MkDocs

Runtime profiling of python bindings for a C/C++ library

C++

Python

performance

runtime

Finding a runtime hotspot in a software stack with Python and, potentially, c++

Azure devops CI pipeline for hydrologic forecasting software

recipes

VCPP

C++

Debian

Windows

Python packaging

R packaging

Azure devops pipeline for a software stack with c++, Python and R packages across multiple repositories.

A whinge about Azure Devops

Azure

devops

Microsoft

A bumpy ride trying to do a relatively simple thing, publish packages from a build pipeline.

Lithology classification using Hugging Face, part 3

hugging-face

NLP

lithology

First working lithology classification training on the Namoi data

Upgrading a C++ streamflow compilation toolchain

recipes

VCPP

C++

Moving a legacy Visual C++ 13 toolchain to Build Tools 2017

Setting up a private conda channel - part 1

conda

conda-channel

Research paths to set up an enterprise-wide private conda channel

Lithology classification using Hugging Face, part 2

hugging-face

NLP

lithology

Exploring the use of NLP to exploit geologic information. Trying to classify lithologies.

Conda package for compiled native libraries

recipes

conda

conda-forge

C++

Journey in building a conda package for C++ libraries

Submitting your first conda package to conda-forge

recipes

conda

conda-forge

Journey in building my first conda package and ending up submitting to conda-forge

Lithology classification using Hugging Face, part 1

hugging-face

NLP

lithology

Exploring the use of NLP to exploit geologic information. Get to know your data.

Victorian Water Measurement Information System

jupyter

hydstra

Trying to simply get access via REST to data in https://data.water.vic.gov.au.

J-M & Andrew Freebairn