Stefan Thoss stefanthoss

🏠

Working from home

Doing data stuff

14 followers · 15 following

San Francisco Bay Area
01:33 (UTC -08:00)
https://blog.stefandroid.com?utm_source=github
@stefandroid@sfba.social

View GitHub Profile

Recently created

Least recently created

Recently updated

Least recently updated

stefanthoss / radarr-mattermost-notify.sh

Last active February 14, 2026 03:57

Radarr custom notification script for Mattermost incoming webhook

	#!/bin/bash

	# --- CONFIGURATION ---
	# Webhook documentation in https://developers.mattermost.com/integrate/webhooks/incoming/
	WEBHOOK_URL="https://mm.example.com/hooks/secretkey"
	CHANNEL="movies"
	USERNAME="Radarr"
	ICON_URL="https://raw.githubusercontent.com/Radarr/Radarr/develop/Logo/256.png"

	# Check if script is run by Radarr

stefanthoss / sonarr-mattermost-notify.sh

Last active February 14, 2026 03:57

Sonarr custom notification script for Mattermost incoming webhook

	#!/bin/bash

	# --- CONFIGURATION ---
	# Webhook documentation in https://developers.mattermost.com/integrate/webhooks/incoming/
	WEBHOOK_URL="https://mm.example.com/hooks/secretkey"
	CHANNEL="shows"
	USERNAME="Sonarr"
	ICON_URL="https://raw.githubusercontent.com/Sonarr/Sonarr/develop/Logo/256.png"

	# Check if script is run by Sonarr

stefanthoss / Dockerfile.nvidia

Last active May 25, 2025 16:28

Install Nvidia drivers in an ARM64 Dockerfile

	ARG NVIDIA_DRIVER_VERSION=570.153.02
	ARG NVIDIA_DRIVER_FILENAME="NVIDIA-Linux-aarch64-${NVIDIA_DRIVER_VERSION}.run"

	RUN apt-get update \
	&& apt-get install -y --no-install-recommends \
	ca-certificates \
	kmod \
	wget \
	&& rm -rf /var/lib/apt/lists/*

stefanthoss / freebsd-check-disk-standby-status.sh

Last active December 25, 2024 23:16

This script checks the standby status of disks in a FreeBSD system (e.g. FreeNAS). It can be used to check whether disks are spinning down properly. For each SATA and IDE hard drive, it will return either standby (0x00) or active/idle (0xff). The script needs to be run as root.

	#!/usr/bin/env bash

	DEVICES=$(camcontrol devlist \| sed 's/.,$.$).*/\1/')

	for DEV in $DEVICES; do
	printf "%s: " "$DEV"
	camcontrol epc "$DEV" -c status -P
	done

stefanthoss / covid-19-bay-area-data.ipynb

Last active July 19, 2021 04:47

COVID-19 in the Bay Area. This Jupyter notebook loads the New York Times data files with cumulative counts of coronavirus cases in the United States from https://github.com/nytimes/covid-19-data and visualizes them for the San Francisco Bay Area.

Sorry, something went wrong. Reload?

Sorry, we cannot display this file.

Sorry, this file is invalid so it cannot be displayed.

stefanthoss / search-pandas-columns-for-string.py

Last active November 12, 2019 05:43

List all columns of a DataFrame that contain a certain character at least once.

	import pandas as pd

	# Input:
	# a b c d e
	# 0 Text Text NaN 0.0 5
	# 1 Text NaN 1.1.1.1 0.0 55
	# 2 Text.Text Text Text 0.4 555

	data = [
	{"a": "Text", "b": "Text", "d": 0, "e": 5},

stefanthoss / find-postgres-tables-by-column.sql

Created October 9, 2019 20:30

Find PostgreSQL tables that have columns which match a certain regex.

	SELECT
	t.table_schema,
	t.table_name,
	c.column_name
	FROM
	information_schema.tables t
	INNER JOIN information_schema.columns c ON c.table_name = t.table_name
	AND c.table_schema = t.table_schema
	WHERE
	c.column_name ~ 'regex'

stefanthoss / advanced-dataframe-union.py

Last active January 28, 2020 19:34

Returns a new PySpark DataFrame containing the union of two DataFrames. This more advanced version works even when the two DataFrames have different columns and a different order of columns. If a column does not exist in either DataFrame, its fields will be empty.

	def advanced_dataframe_union(df1, df2):
	df1_fields = set((f.name, f.dataType) for f in df1.schema)
	df2_fields = set((f.name, f.dataType) for f in df2.schema)

	df2 = df2.select(
	df2.columns
	+ [
	F.lit(None).cast(datatype).alias(name)
	for name, datatype in df1_fields.difference(df2_fields)
	]

stefanthoss / pbzip2.Dockerfile

Last active March 26, 2024 11:29

Install pbzip2 in an Alpine Linux Docker image

	FROM alpine:3.10

	RUN apk add --no-cache \
	bzip2-dev \
	g++ \
	make

	RUN cd /tmp/ && \
	wget -q https://launchpad.net/pbzip2/1.1/1.1.13/+download/pbzip2-1.1.13.tar.gz && \
	tar -xzf pbzip2-1.1.13.tar.gz && \

stefanthoss / export-pyspark-schema-to-json.py

Created June 19, 2019 22:16

Export/import a PySpark schema to/from a JSON file

	import json
	from pyspark.sql.types import *

	# Define the schema
	schema = StructType(
	[StructField("name", StringType(), True), StructField("age", IntegerType(), True)]
	)

	# Write the schema
	with open("schema.json", "w") as f:

NewerOlder