her.esy.fun/src/drafts/XXXX-how-i-use-nix/index.org

311 lines
8.7 KiB
Org Mode
Raw Normal View History

2020-06-14 14:16:23 +00:00
#+Title: How I use nix
#+Author: Yann Esposito
#+Email: yann@esposito.host
#+Date: [2020-06-14 Sun]
2021-04-27 13:21:06 +00:00
#+KEYWORDS: nix programming
2020-06-25 12:22:58 +00:00
#+DESCRIPTION: In this article I explain how I use nix. As a brew replacement, as home environment manager, to have reproductible dev environment.
2020-06-14 14:16:23 +00:00
#+LANGUAGE: en
#+LANG: en
#+OPTIONS: H:5 auto-id:t toc:nil
#+STARTUP: showeverything
2020-06-14 21:52:09 +00:00
Have you ever written a small script and you update your system and this
stop working?
Have you copied your tool/script to another machine it doesn't work because
some dependency is missing?
Have you tried to sync your dotfiles to another env and there are a few
details not working? Some missing dependency?
If the answer is yes, then [[https://nixos.org/nix][nix]] can help.
** Scripts
:PROPERTIES:
:CUSTOM_ID: scripts
:END:
2020-06-14 14:16:23 +00:00
2020-06-14 21:52:09 +00:00
Suppose you want to write a portable script.
For example, the script I use to minify my CSS.
Here it is:
2020-06-14 14:16:23 +00:00
2020-06-14 21:52:09 +00:00
#+begin_src shell
#!/usr/bin/env nix-shell
#!nix-shell --pure
#!nix-shell -i bash
#!nix-shell -I nixpkgs="https://github.com/NixOS/nixpkgs/archive/19.09.tar.gz"
#!nix-shell -p bash minify
minify "$1" > "$2"
#+end_src
So let's analyze each line of the header block:
- ~#!/usr/bin/env nix-shell~ :: basic, use ~nix-shell~ to run the script.
- ~#!nix-shell --pure~ :: only use dependencies installed in this nix shell
environment. A bit as if the PATH environment variable was emptied.
- ~#!nix-shell -i bash~ :: tell ~nix-shell~ to run ~bash~
- ~#!nix-shell -I nixpkgs="https://github.com/NixOS/nixpkgs/archive/19.09.tar.gz"~ ::
pin the nixpkgs using this archive.
- ~#!nix-shell -p bash minify~ :: install ~bash~ and ~minify~ in the nix shell.
Now if the script is run on a machine with ~nix~ installed you can be
pretty sure it will work as expected.
Even if I update my OS and I forget about this script for a few years.
As long as I can install nix on the new system and I could download the tar
file the script will be run the same way as the day I wrote it.
2020-06-14 22:02:26 +00:00
**Remark**:
You can use any shell (like ~fish~, ~zsh~) but also other languages
~python~, ~haskell~, etc...
2020-06-14 21:52:09 +00:00
** Temporary working env
:PROPERTIES:
:CUSTOM_ID: temporary-working-env
:END:
Quite often, I need to do something, and run a specific command that need
me to install a very specific command.
And I'm pretty sure I will not use this tool ever again.
For those cases, what I do, is generally run my command directly with a
fresh ~nix-shell~.
#+begin_src shell
> nix-shell -p httpie
[nix-shell:~]$ ... here I can use httpie ...
#+end_src
2020-06-14 14:16:23 +00:00
2020-06-14 22:45:51 +00:00
If I don't use ~httpie~ for a while it will be garbage collected
eventually.
2020-06-14 14:16:23 +00:00
** Home Manager
:PROPERTIES:
:CUSTOM_ID: home-manager
:END:
2020-06-14 21:52:09 +00:00
A few years ago I used =brew= to install the tools I need.
With =nix= you can install a new tool with ~nix-env -i~ instead of ~brew install~.
Still recently I prefer to use [[https://github.com/rycee/home-manager][home-manager]].
The main advantage is that it is even more reproductible and can easily be
shared accross different machines.
2020-06-14 14:16:23 +00:00
2020-06-14 21:52:09 +00:00
Mainly when I need a new binary I add it in a description list in the file
=~/.config/nixpkgs/home.nix=.
It looks like this:
2020-06-14 14:16:23 +00:00
#+begin_src nix
2020-06-14 21:52:09 +00:00
home.packages = with pkgs; [
# emacs
emacsMacport
imagemagick
gnupg
# shell
direnv
...
];
#+end_src
then I simply run ~home-manager switch~ and I've got all those tools in my env.
*** Pinning the packages
:PROPERTIES:
:CUSTOM_ID: pinning-the-packages
:END:
#+begin_src nix
{ config, pkgs, ... }:
let
# ...
pkgs = import (fetchGit {
name = "nixpkgs20";
url = "https://github.com/NixOS/nixpkgs";
# obtained via
# git ls-remote https://github.com/NixOS/nixpkgs nixpkgs-20.03-darwin
ref = "refs/heads/nixpkgs-20.03-darwin";
rev = "58f884cd3d89f47672e649c6edfb2382d4afff6a";
}) {};
# ...
in {
# ...
}
2020-06-14 14:16:23 +00:00
#+end_src
2020-06-14 21:52:09 +00:00
*** Specific tools
:PROPERTIES:
:CUSTOM_ID: specific-tools
:END:
2020-06-16 22:10:49 +00:00
There are a few noticiable artifacts here:
2020-06-14 14:16:23 +00:00
2020-06-14 21:52:09 +00:00
The first one is ~weechat~ is a very specify build of weechat with the
2020-06-14 22:02:26 +00:00
plugin I need.
2020-06-16 22:10:49 +00:00
For that I created a new directory =weechat-with-weeslack= containing a
=default.nix=:
2020-06-14 14:16:23 +00:00
#+begin_src nix
2020-06-16 22:10:49 +00:00
{ pkgs, ...}:
pkgs.weechat.override {
configure = { availablePlugins, ... }: {
# plugins = with availablePlugins; [ python perl guile ];
scripts = with pkgs.weechatScripts; [ wee-slack ];
};
2020-06-14 21:52:09 +00:00
}
2020-06-14 14:16:23 +00:00
#+end_src
2020-06-16 22:10:49 +00:00
And in my =home.nix= I use:
#+begin_src nix
weechat-with-weeslack = import ./weechat-with-weeslack {
inherit pkgs;
};
#+end_src
2020-06-14 22:02:26 +00:00
Even if this looks cryptic.
The important detail is just that there exists a way to say to nix I'd like
to use weechat (an IRC client) with the wee-slack client (which uses python).
2020-06-16 22:10:49 +00:00
And nix handle the rest for me without any conflict.
2020-06-14 14:16:23 +00:00
2020-06-14 21:52:09 +00:00
*** Another nice tool is =sws=
:PROPERTIES:
:CUSTOM_ID: another-nice-tool-is--sws-
:END:
I use macOS so even though I'm using a darwin focused nixpkgs
sometimes a few package can be broken and can't be installed.
That occurred with [[https://hackage.haskell.org/package/sws][=sws=]] during the upgrade to 20.03 on darwin.
This is a simple tool that need haskell to be compiled locally and
installed.
Here is how I could install it:
2020-06-14 14:16:23 +00:00
#+begin_src nix
let
...
rel19 = import (fetchGit {
name = "nixpkgs19";
url = "https://github.com/NixOS/nixpkgs";
ref = "refs/heads/nixpkgs-19.09-darwin";
rev = "2f9bafaca90acd010cccd0e79e5f27aa7537957e";
}) {};
2020-06-16 22:10:49 +00:00
haskellDeps = ps: with ps; [
base
protolude
tidal
shake
rel19.haskellPackages.sws
];
ghc = pkgs.haskellPackages.ghcWithPackages haskellDeps;
2020-06-14 14:16:23 +00:00
...
in
home.packages = with pkgs; [
...
ghc
...
]
#+end_src
So I used the older version from 19.09.
2020-06-16 22:10:49 +00:00
** Dev environment
:PROPERTIES:
:CUSTOM_ID: dev-environment
:END:
When working on a project.
You can produce a pretty good local environment.
For example, for my blog, I only use emacs and a few shell scripts.
Still I needed to fix a few binaries, like the correct ~date~ via
~coreutils~.
And also I use ~html-xml-utils~ to easily deal with html/xml parsing.
I use it to generate my RSS xml file.
So I have a ~shell.nix~ files at the root of my project:
#+begin_src nix
{ pkgs ? import (fetchTarball https://github.com/NixOS/nixpkgs/archive/19.09.tar.gz) {} }:
let my_aspell = pkgs.aspellWithDicts(p: with p; [en fr]);
in
pkgs.mkShell {
buildInputs = [ pkgs.coreutils
pkgs.html-xml-utils
pkgs.zsh
pkgs.perl
pkgs.perlPackages.URI
pkgs.minify
pkgs.haskellPackages.sws
pkgs.cacert
];
}
#+end_src
So I just need to launch ~nix-shell~ and I have my environment.
A nice addition is to use direnv[fn:direnv] which support ~nix-shell~ by putting
~use_nix~ inside the ~.envrc~ at the root of the project.
But by default invoking ~nix-shell~ can take a few seconds everytime.
But we can do even better by using lorri[fn:lorri].
I start the lorri daemon in my ~StartupItems~ mainly I simply created
the file =~/Library/LaunchAgents/com.github.target.lorri.plist=:
#+begin_src xml :tangle com.github.target.lorri.plist :mkdirp t
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
<key>Label</key>
<string>com.github.target.lorri</string>
<key>ProgramArguments</key>
<array>
<string>/bin/zsh</string>
<string>-i</string>
<string>-c</string>
<string>$HOME/.nix-profile/bin/lorri daemon</string>
</array>
<key>StandardOutPath</key>
<string>/var/tmp/lorri.log</string>
<key>StandardErrorPath</key>
<string>/var/tmp/lorri.log</string>
<key>RunAtLoad</key>
<true/>
<key>KeepAlive</key>
<true/>
</dict>
</plist>
#+end_src
And started the daemon with:
#+begin_src bash
launchctl load ~/Library/LaunchAgents/com.github.target.lorri.plist
#+end_src
~lorri~ takes care of keeping a cache and watch my configuration change by
project.
This makes the call to ~direnv~ almost instantaneous and seemless.
I just changed the content of my ~.envrc~ with:
#+begin_src shell
eval "$(lorri direnv)"
#+end_src
And of course this would work the same way with more complex ~shell.nix~.
Typically for Haskell projects.
[fn:direnv] https://direnv.net
[fn:lorri] https://github.com/target/lorri
2020-06-14 21:52:09 +00:00
** Install
:PROPERTIES:
:CUSTOM_ID: install
:END:
2020-06-16 22:10:49 +00:00
So you would like to use nix too?
2020-06-14 21:52:09 +00:00
First, let's start by the bad news.
Recent macOS security policy made nix a bit harder to install on a mac.
See [[https://hydra.nixos.org/build/119559243/download/1/manual/#sect-macos-installation][macOS Installation instructions]].
Once you have nix installed you should update the nix-channel.
Mainly a nix-channels is where are the definitions of all the packages.
See [[https://hydra.nixos.org/build/119559243/download/1/manual/#sec-channels][nixOS documentation]].
2020-06-14 14:16:23 +00:00