BlueGit

timfa bluegit

Merge branch 'cursor/bluegit-basis-65da' into 'master'

Eerste basis van BlueGit

See merge request Timfa/bluegit!1

timfa Tim Falken · pushed by timfa

Authored 2026-10-21 · 3 weeks ago

Hash
9a39819e6387b2f15b75a97a8a91722ad202cef7
66 files changed +10530 −57
.gitignore added +13 −0
@@ -0,0 +1,13 @@
1 /bluegit
2 /data
3 *.db
4 *.db-journal
5 *.db-wal
6 *.db-shm
7 secret.key
8 /dist
9 /packaging/arch/src
10 /packaging/arch/pkg
11 /packaging/arch/*.pkg.tar.zst
12 /packaging/arch/*.tar.gz
13 .bluegit
@@ -0,0 +1,13 @@
1/bluegit
2/data
3*.db
4*.db-journal
5*.db-wal
6*.db-shm
7secret.key
8/dist
9/packaging/arch/src
10/packaging/arch/pkg
11/packaging/arch/*.pkg.tar.zst
12/packaging/arch/*.tar.gz
13.bluegit
.gitlab-ci.yml added +10 −0
@@ -0,0 +1,10 @@
1 # Tijdelijke GitLab-pipeline, zolang deze repository nog op gitlab.com staat.
2 # BlueGit zelf leest blue-ci-cd.yml, niet dit bestand.
3
4 stages: [test]
5
6 go-test:
7 stage: test
8 image: golang:1.22
9 script:
10 - go test ./...
@@ -0,0 +1,10 @@
1# Tijdelijke GitLab-pipeline, zolang deze repository nog op gitlab.com staat.
2# BlueGit zelf leest blue-ci-cd.yml, niet dit bestand.
3
4stages: [test]
5
6go-test:
7 stage: test
8 image: golang:1.22
9 script:
10 - go test ./...
LICENSE added +21 −0
@@ -0,0 +1,21 @@
1 MIT License
2
3 Copyright (c) 2026 Tim Falken
4
5 Permission is hereby granted, free of charge, to any person obtaining a copy
6 of this software and associated documentation files (the "Software"), to deal
7 in the Software without restriction, including without limitation the rights
8 to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9 copies of the Software, and to permit persons to whom the Software is
10 furnished to do so, subject to the following conditions:
11
12 The above copyright notice and this permission notice shall be included in all
13 copies or substantial portions of the Software.
14
15 THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16 IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17 FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18 AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19 LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20 OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21 SOFTWARE.
@@ -0,0 +1,21 @@
1MIT License
2
3Copyright (c) 2026 Tim Falken
4
5Permission is hereby granted, free of charge, to any person obtaining a copy
6of this software and associated documentation files (the "Software"), to deal
7in the Software without restriction, including without limitation the rights
8to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9copies of the Software, and to permit persons to whom the Software is
10furnished to do so, subject to the following conditions:
11
12The above copyright notice and this permission notice shall be included in all
13copies or substantial portions of the Software.
14
15THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21SOFTWARE.
README.md +79 −57
@@ -1,93 +1,115 @@
1 1 # BlueGit
2 2
3 BlueGit is Tims eigen git-platform, bedoeld voor `git.timfalken.com` op een mini-PC met Arch Linux. De repositories staan op een configureerbare schijf (de 4 TB-disk). Aanmelden gaat via [auth.timfalken.com](https://auth.timfalken.com). Er is geen lokaal wachtwoord.
3 4
5 Het logo is Tims blauwe ster: [`assets/logo.svg`](assets/logo.svg).
4 6
5 ## Getting started
7 ![BlueGit](assets/logo.svg)
6 8
7 To make it easy for you to get started with GitLab, here's a list of recommended next steps.
9 ## Stack
8 10
9 Already a pro? Just edit this README.md and make it your own. Want to make it easy? [Use the template at the bottom](#editing-this-readme)!
11 Eén statische Go-binary, SQLite voor de metadata, de gewone `git` voor de objecten, en Docker alleen voor CI-jobs.
10 12
11 ## Add your files
13 Die keuze houdt de mini-PC klein. Er is geen Postgres, geen Redis en geen aparte frontend-build. Git zelf doet smart HTTP; dat protocol opnieuw bouwen levert niets op. SQLite past bij één machine en één beheerder: de database is een bestand naast de repositories, op dezelfde schijf. Een kant-en-klaar product als Forgejo zou sneller een volle forge geven, maar niet deze auth-server, dit CI-bestand of dit webhookmodel.
12 14
13 * [Create](https://docs.gitlab.com/user/project/repository/web_editor/#create-a-file) or [upload](https://docs.gitlab.com/user/project/repository/web_editor/#upload-a-file) files
14 * [Add files using the command line](https://docs.gitlab.com/topics/git/add_files/#add-files-to-a-git-repository) or push an existing Git repository with the following command:
15 ## Wat deze basis al doet
15 16
16 ```
17 cd existing_repo
18 git remote add origin https://gitlab.com/Timfa/bluegit.git
19 git branch -M master
20 git push -uf origin master
17 - Aanmelden met de authorization-code-flow van auth.timfalken.com. De eerste ingelogde gebruiker wordt installatiebeheerder. `is_admin` van de auth-server geeft die rol niet, en de vlag geeft geen toegang tot andermans repositories, groepen of geheimen.
18 - Repositories van een gebruiker of een groep, met de rollen alleen-lezen, ontwikkelaar en beheerder. De standaardbranch is `master`.
19 - Git over HTTPS (smart HTTP) en SSH. Achter de ingress is HTTP plain, en de clone-URL gebruikt `ssh.public_host` en `ssh.public_port`. `ssh.listen` is de poort op de mini-PC.
20 - Webinterface: bestanden, commits, branches, merge requests, pipelines, releases, leden, geheimen en webhooks.
21 - `blue-ci-cd.yml`: stages, jobs, `needs`, `rules`, artifacts. Elke job in een eigen container.
22 - Geheimen als omgevingsvariabelen. Beschermde geheimen alleen op een beschermde branch.
23 - Releases op een commit, vanuit een pipeline met een job-token. Artifacts worden release-bestanden.
24 - Webhooks op repository en groep, met presets voor Discord, Grok Bot en een generieke JSON-webhook. Bestemmingen in privénetwerken worden geweigerd; het IP wordt bij het verbinden vastgezet.
25 - Een PKGBUILD, een systemd-unit en `packaging/install.sh`.
26
27 Wat nog niet af is, staat in [docs/ROADMAP.md](docs/ROADMAP.md). De vorm van het systeem staat in [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md). De auth-koppeling staat in [docs/AUTH.md](docs/AUTH.md). De ingress staat in [docs/INGRESS.md](docs/INGRESS.md). De besluiten staan in [docs/VRAGEN.md](docs/VRAGEN.md).
28
29 ## Lokaal proberen
30
31 `auth.mode: dev` maakt een sessie zonder de auth-server. Dat is geen wachtwoord, en de configuratie weigert deze modus zodra `base_url` op `git.timfalken.com` wijst.
32
33 ```yaml
34 base_url: http://127.0.0.1:8080
35 listen: 127.0.0.1:8080
36 auth:
37 mode: dev
38 dev_user: tim
39 ssh:
40 enabled: false
41 ci:
42 enabled: false
21 43 ```
22 44
23 ## Integrate with your tools
45 Laat `storage_path` weg. Na het aanmelden vraagt BlueGit om een absoluut pad dat al bestaat, beschrijfbaar is en minstens 1 GiB vrij heeft. `mkdir -p "$PWD/data"` en plak het absolute pad in dat scherm. Zet je toch `storage_path` in dit bestand, dan moet dat pad absoluut zijn; het slaat het scherm over zolang de state-map nog geen keuze bewaart.
24 46
25 * [Set up project integrations](https://gitlab.com/Timfa/bluegit/-/settings/integrations)
47 ```shell
48 go build -o bluegit ./cmd/bluegit
49 ./bluegit serve --config bluegit.yml
50 ```
26 51
27 ## Collaborate with your team
52 Open http://127.0.0.1:8080 en meld aan. Onder Account maak je een toegangstoken. Git gebruikt dat token als wachtwoord:
28 53
29 * [Invite team members and collaborators](https://docs.gitlab.com/user/project/members/)
30 * [Create a new merge request](https://docs.gitlab.com/user/project/merge_requests/creating_merge_requests/)
31 * [Automatically close issues from merge requests](https://docs.gitlab.com/user/project/issues/managing_issues/#closing-issues-automatically)
32 * [Enable merge request approvals](https://docs.gitlab.com/user/project/merge_requests/approvals/)
33 * [Set auto-merge](https://docs.gitlab.com/user/project/merge_requests/auto_merge/)
54 ```shell
55 git clone http://tim:bg_…@127.0.0.1:8080/tim/demo.git
56 ```
34 57
35 ## Test and Deploy
58 ## Installeren op Arch
36 59
37 Use the built-in continuous integration in GitLab.
60 Eerste keer met de hand, daarna kan de pipeline in [`blue-ci-cd.yml`](blue-ci-cd.yml) de binary vervangen.
38 61
39 * [Get started with GitLab CI/CD](https://docs.gitlab.com/ci/quick_start/)
40 * [Analyze your code for known vulnerabilities with Static Application Security Testing (SAST)](https://docs.gitlab.com/user/application_security/sast/)
41 * [Deploy to Kubernetes, Amazon EC2, or Amazon ECS using Auto Deploy](https://docs.gitlab.com/topics/autodevops/requirements/)
42 * [Use pull-based deployments for improved Kubernetes management](https://docs.gitlab.com/user/clusters/agent/)
43 * [Set up protected environments](https://docs.gitlab.com/ci/environments/protected_environments/)
62 ```shell
63 sudo packaging/install.sh
64 # of, vanuit de repository:
65 cd packaging/arch && makepkg -si
66 ```
44 67
45 ***
68 Daarna:
46 69
47 # Editing this README
70 1. Mount de 4 TB-schijf op een pad dat jij kiest. Maak die map beschrijfbaar voor de gebruiker `bluegit`. Er is geen standaardpad.
71 2. Kopieer `/usr/share/bluegit/storage.conf.example` naar `/etc/systemd/system/bluegit.service.d/storage.conf` en zet `ReadWritePaths` op die map. Zonder die drop-in blokkeert `ProtectSystem` schrijven buiten `/var/lib/bluegit`, en de schrijftest in het setup-scherm faalt. De database blijft in `/var/lib/bluegit`.
72 3. Registreer bij https://auth.timfalken.com/admin het domein `git.timfalken.com` met callback-pad `/auth/callback`. Het client_id is het domein. Het geheim verschijnt één keer.
73 4. Zet het geheim in `/etc/bluegit/client_secret` (mode `0600`) of in `BLUEGIT_AUTH_CLIENT_SECRET` via `/etc/bluegit/secret.env`.
74 5. Zet de ingress op de andere machine. BlueGit zelf blijft plain HTTP. `trusted_proxies` is het adres van die ingress, `base_url` is `https://git.timfalken.com`, en `ssh.public_port` is de poort die gebruikers zien. Het voorbeeld staat in [docs/INGRESS.md](docs/INGRESS.md).
75 6. `systemctl daemon-reload && systemctl enable --now bluegit`. De eerste aanmelding wordt installatiebeheerder en kiest het pad in het setup-scherm. Daar staat ook hoeveel ruimte vrij is. Git en CI doen niets tot dat pad opgeslagen is.
48 76
49 When you're ready to make this README your own, just edit this file and use the handy template below (or feel free to structure it however you want - this is just a starting point!). Thanks to [makeareadme.com](https://www.makeareadme.com/) for this template.
77 SSH voor git luistert op `ssh.listen` (in het voorbeeld `0.0.0.0:2222`), naast de SSH van het besturingssysteem. De hostkey komt de eerste keer in de opslagmap. De clone-URL gebruikt `ssh.public_host` en `ssh.public_port`, niet de bindpoort.
50 78
51 ## Suggestions for a good README
79 ## Rollen
52 80
53 Every project is different, so consider which of these sections apply to yours. The sections used in the template are suggestions for most open source projects. Also keep in mind that while a README can be too long and detailed, too long is better than too short. If you think your README is too long, consider utilizing another form of documentation rather than cutting out information.
81 Een repository hoort bij een gebruiker (die is beheerder) of bij een groep. Iemand kan ook rechtstreeks lid zijn. De hoogste rol telt.
54 82
55 ## Name
56 Choose a self-explaining name for your project.
83 | Rol | Lezen | Schrijven op een gewone branch | Beschermde branch | Geheimen, webhooks, leden, verwijderen |
84 | --- | --- | --- | --- | --- |
85 | Alleen lezen | ja | nee | nee | nee |
86 | Ontwikkelaar | ja | ja | nee | nee |
87 | Beheerder | ja | ja | ja | ja |
57 88
58 ## Description
59 Let people know what your project can do specifically. Provide context and add a link to any reference visitors might be unfamiliar with. A list of Features or a Background subsection can also be added here. If there are alternatives to your project, this is a good place to list differentiating factors.
89 Een ontwikkelaar ziet geheimen niet terug. Een job krijgt ze wel als omgevingsvariabele, anders kan CI er niets mee. Wie een pipeline mag starten, kan een onbeschermd geheim dus uitlezen via `blue-ci-cd.yml`. Markeer een geheim als beschermd als het alleen op een beschermde branch mee mag, en bescherm `master`.
60 90
61 ## Badges
62 On some READMEs, you may see small images that convey metadata, such as whether or not all the tests are passing for the project. You can use Shields to add some to your README. Many services also have instructions for adding a badge.
91 De installatiebeheerder is geen beheerder van andermans repository. Geheimen, groepen en privérepositories blijven bij de leden.
63 92
64 ## Visuals
65 Depending on what you are making, it can be a good idea to include screenshots or even a video (you'll frequently see GIFs rather than actual videos). Tools like ttygif can help, but check out Asciinema for a more sophisticated method.
93 ## CI, releases, webhooks
66 94
67 ## Installation
68 Within a particular ecosystem, there may be a common way of installing things, such as using Yarn, NuGet, or Homebrew. However, consider the possibility that whoever is reading your README is a novice and would like more guidance. Listing specific steps helps remove ambiguity and gets people to using your project as quickly as possible. If it only runs in a specific context like a particular programming language version or operating system or has dependencies that have to be installed manually, also add a Requirements subsection.
95 De specificatie staat in [docs/CI.md](docs/CI.md). Kort: `stages`, `jobs`, `image`, `script`, `needs`, `rules`, `artifacts`. Elke job is `docker run` van dat image.
69 96
70 ## Usage
71 Use examples liberally, and show the expected output if you can. It's helpful to have inline the smallest example of usage that you can demonstrate, while providing links to more sophisticated examples if they are too long to reasonably include in the README.
97 Een release maakt de pipeline zelf, met `CI_JOB_TOKEN` en `CI_API_URL`. Bestanden komen uit artifacts van een eerdere job in dezelfde pipeline, niet uit de request-body.
72 98
73 ## Support
74 Tell people where they can go to for help. It can be any combination of an issue tracker, a chat room, an email address, etc.
99 Webhooks hebben een URL-sjabloon, eigen headers en een body-sjabloon. `{{secret.NAAM}}` en `{{event.summary}}` worden bij het versturen ingevuld. Een push kan gefilterd worden op een exacte branch of op `re:` plus een reguliere expressie. Presets: `discord`, `grok` (JSON met een `Authorization`-header) en `generic`. Een bestemming in een privénetwerk, of een naam die daarheen oplost, wordt geweigerd. Het IP van een publieke naam wordt vastgezet op het moment van verbinden, en elke redirect wordt opnieuw gekeurd.
75 100
76 ## Roadmap
77 If you have ideas for releases in the future, it is a good idea to list them in the README.
101 ## Zelf bijwerken
78 102
79 ## Contributing
80 State if you are open to contributions and what your requirements are for accepting them.
103 [`blue-ci-cd.yml`](blue-ci-cd.yml) test, bouwt een statische binary, maakt een release en kopieert die via SSH naar de host. Daar is geen apart deploy-kanaal voor. De eerste binary zet je neer met het pakket. Daarna zijn de geheimen `DEPLOY_HOST`, `DEPLOY_USER`, `DEPLOY_PORT`, `DEPLOY_PATH` en `DEPLOY_SSH_KEY` genoeg, als beschermde geheimen op een beschermde branch.
81 104
82 For people who want to make changes to your project, it's helpful to have some documentation on how to get started. Perhaps there is a script that they should run or some environment variables that they need to set. Make these steps explicit. These instructions could also be useful to your future self.
105 ## Tests
83 106
84 You can also document commands to lint the code or run tests. These steps help to ensure high code quality and reduce the likelihood that the changes inadvertently break something. Having instructions for running tests is especially helpful if it requires external setup, such as starting a Selenium server for testing in a browser.
107 ```shell
108 go test ./...
109 ```
85 110
86 ## Authors and acknowledgment
87 Show your appreciation to those who have contributed to the project.
111 De kern zit in `internal/access` (rollen en beschermde branches), `internal/ci` (de parser en wanneer een job mag starten) en `internal/webhook` (filters en sjablonen). `internal/server` doet een ronde met een echte `git push` en controleert dat een ontwikkelaar geen geheim kan opslaan.
88 112
89 ## License
90 For open source projects, say how it is licensed.
113 ## Licentie
91 114
92 ## Project status
93 If you have run out of energy or time for your project, put a note at the top of the README saying that development has slowed down or stopped completely. Someone may choose to fork your project or volunteer to step in as a maintainer or owner, allowing your project to keep going. You can also make an explicit request for maintainers.
115 MIT. Zie [LICENSE](LICENSE).
@@ -1,93 +1,115 @@
1# BlueGit
1# BlueGit
2
2
3BlueGit is Tims eigen git-platform, bedoeld voor `git.timfalken.com` op een mini-PC met Arch Linux. De repositories staan op een configureerbare schijf (de 4 TB-disk). Aanmelden gaat via [auth.timfalken.com](https://auth.timfalken.com). Er is geen lokaal wachtwoord.
3
4
5Het logo is Tims blauwe ster: [`assets/logo.svg`](assets/logo.svg).
4
6
5## Getting started
7![BlueGit](assets/logo.svg)
6
8
7To make it easy for you to get started with GitLab, here's a list of recommended next steps.
9## Stack
8
10
9Already a pro? Just edit this README.md and make it your own. Want to make it easy? [Use the template at the bottom](#editing-this-readme)!
11Eén statische Go-binary, SQLite voor de metadata, de gewone `git` voor de objecten, en Docker alleen voor CI-jobs.
10
12
11## Add your files
13Die keuze houdt de mini-PC klein. Er is geen Postgres, geen Redis en geen aparte frontend-build. Git zelf doet smart HTTP; dat protocol opnieuw bouwen levert niets op. SQLite past bij één machine en één beheerder: de database is een bestand naast de repositories, op dezelfde schijf. Een kant-en-klaar product als Forgejo zou sneller een volle forge geven, maar niet deze auth-server, dit CI-bestand of dit webhookmodel.
12
14
13* [Create](https://docs.gitlab.com/user/project/repository/web_editor/#create-a-file) or [upload](https://docs.gitlab.com/user/project/repository/web_editor/#upload-a-file) files
15## Wat deze basis al doet
14* [Add files using the command line](https://docs.gitlab.com/topics/git/add_files/#add-files-to-a-git-repository) or push an existing Git repository with the following command:
15
16
16```
17- Aanmelden met de authorization-code-flow van auth.timfalken.com. De eerste ingelogde gebruiker wordt installatiebeheerder. `is_admin` van de auth-server geeft die rol niet, en de vlag geeft geen toegang tot andermans repositories, groepen of geheimen.
17cd existing_repo
18- Repositories van een gebruiker of een groep, met de rollen alleen-lezen, ontwikkelaar en beheerder. De standaardbranch is `master`.
18git remote add origin https://gitlab.com/Timfa/bluegit.git
19- Git over HTTPS (smart HTTP) en SSH. Achter de ingress is HTTP plain, en de clone-URL gebruikt `ssh.public_host` en `ssh.public_port`. `ssh.listen` is de poort op de mini-PC.
19git branch -M master
20- Webinterface: bestanden, commits, branches, merge requests, pipelines, releases, leden, geheimen en webhooks.
20git push -uf origin master
21- `blue-ci-cd.yml`: stages, jobs, `needs`, `rules`, artifacts. Elke job in een eigen container.
22- Geheimen als omgevingsvariabelen. Beschermde geheimen alleen op een beschermde branch.
23- Releases op een commit, vanuit een pipeline met een job-token. Artifacts worden release-bestanden.
24- Webhooks op repository en groep, met presets voor Discord, Grok Bot en een generieke JSON-webhook. Bestemmingen in privénetwerken worden geweigerd; het IP wordt bij het verbinden vastgezet.
25- Een PKGBUILD, een systemd-unit en `packaging/install.sh`.
26
27Wat nog niet af is, staat in [docs/ROADMAP.md](docs/ROADMAP.md). De vorm van het systeem staat in [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md). De auth-koppeling staat in [docs/AUTH.md](docs/AUTH.md). De ingress staat in [docs/INGRESS.md](docs/INGRESS.md). De besluiten staan in [docs/VRAGEN.md](docs/VRAGEN.md).
28
29## Lokaal proberen
30
31`auth.mode: dev` maakt een sessie zonder de auth-server. Dat is geen wachtwoord, en de configuratie weigert deze modus zodra `base_url` op `git.timfalken.com` wijst.
32
33```yaml
34base_url: http://127.0.0.1:8080
35listen: 127.0.0.1:8080
36auth:
37 mode: dev
38 dev_user: tim
39ssh:
40 enabled: false
41ci:
42 enabled: false
21```
43```
22
44
23## Integrate with your tools
45Laat `storage_path` weg. Na het aanmelden vraagt BlueGit om een absoluut pad dat al bestaat, beschrijfbaar is en minstens 1 GiB vrij heeft. `mkdir -p "$PWD/data"` en plak het absolute pad in dat scherm. Zet je toch `storage_path` in dit bestand, dan moet dat pad absoluut zijn; het slaat het scherm over zolang de state-map nog geen keuze bewaart.
24
46
25* [Set up project integrations](https://gitlab.com/Timfa/bluegit/-/settings/integrations)
47```shell
48go build -o bluegit ./cmd/bluegit
49./bluegit serve --config bluegit.yml
50```
26
51
27## Collaborate with your team
52Open http://127.0.0.1:8080 en meld aan. Onder Account maak je een toegangstoken. Git gebruikt dat token als wachtwoord:
28
53
29* [Invite team members and collaborators](https://docs.gitlab.com/user/project/members/)
54```shell
30* [Create a new merge request](https://docs.gitlab.com/user/project/merge_requests/creating_merge_requests/)
55git clone http://tim:bg_…@127.0.0.1:8080/tim/demo.git
31* [Automatically close issues from merge requests](https://docs.gitlab.com/user/project/issues/managing_issues/#closing-issues-automatically)
56```
32* [Enable merge request approvals](https://docs.gitlab.com/user/project/merge_requests/approvals/)
33* [Set auto-merge](https://docs.gitlab.com/user/project/merge_requests/auto_merge/)
34
57
35## Test and Deploy
58## Installeren op Arch
36
59
37Use the built-in continuous integration in GitLab.
60Eerste keer met de hand, daarna kan de pipeline in [`blue-ci-cd.yml`](blue-ci-cd.yml) de binary vervangen.
38
61
39* [Get started with GitLab CI/CD](https://docs.gitlab.com/ci/quick_start/)
62```shell
40* [Analyze your code for known vulnerabilities with Static Application Security Testing (SAST)](https://docs.gitlab.com/user/application_security/sast/)
63sudo packaging/install.sh
41* [Deploy to Kubernetes, Amazon EC2, or Amazon ECS using Auto Deploy](https://docs.gitlab.com/topics/autodevops/requirements/)
64# of, vanuit de repository:
42* [Use pull-based deployments for improved Kubernetes management](https://docs.gitlab.com/user/clusters/agent/)
65cd packaging/arch && makepkg -si
43* [Set up protected environments](https://docs.gitlab.com/ci/environments/protected_environments/)
66```
44
67
45***
68Daarna:
46
69
47# Editing this README
701. Mount de 4 TB-schijf op een pad dat jij kiest. Maak die map beschrijfbaar voor de gebruiker `bluegit`. Er is geen standaardpad.
712. Kopieer `/usr/share/bluegit/storage.conf.example` naar `/etc/systemd/system/bluegit.service.d/storage.conf` en zet `ReadWritePaths` op die map. Zonder die drop-in blokkeert `ProtectSystem` schrijven buiten `/var/lib/bluegit`, en de schrijftest in het setup-scherm faalt. De database blijft in `/var/lib/bluegit`.
723. Registreer bij https://auth.timfalken.com/admin het domein `git.timfalken.com` met callback-pad `/auth/callback`. Het client_id is het domein. Het geheim verschijnt één keer.
734. Zet het geheim in `/etc/bluegit/client_secret` (mode `0600`) of in `BLUEGIT_AUTH_CLIENT_SECRET` via `/etc/bluegit/secret.env`.
745. Zet de ingress op de andere machine. BlueGit zelf blijft plain HTTP. `trusted_proxies` is het adres van die ingress, `base_url` is `https://git.timfalken.com`, en `ssh.public_port` is de poort die gebruikers zien. Het voorbeeld staat in [docs/INGRESS.md](docs/INGRESS.md).
756. `systemctl daemon-reload && systemctl enable --now bluegit`. De eerste aanmelding wordt installatiebeheerder en kiest het pad in het setup-scherm. Daar staat ook hoeveel ruimte vrij is. Git en CI doen niets tot dat pad opgeslagen is.
48
76
49When you're ready to make this README your own, just edit this file and use the handy template below (or feel free to structure it however you want - this is just a starting point!). Thanks to [makeareadme.com](https://www.makeareadme.com/) for this template.
77SSH voor git luistert op `ssh.listen` (in het voorbeeld `0.0.0.0:2222`), naast de SSH van het besturingssysteem. De hostkey komt de eerste keer in de opslagmap. De clone-URL gebruikt `ssh.public_host` en `ssh.public_port`, niet de bindpoort.
50
78
51## Suggestions for a good README
79## Rollen
52
80
53Every project is different, so consider which of these sections apply to yours. The sections used in the template are suggestions for most open source projects. Also keep in mind that while a README can be too long and detailed, too long is better than too short. If you think your README is too long, consider utilizing another form of documentation rather than cutting out information.
81Een repository hoort bij een gebruiker (die is beheerder) of bij een groep. Iemand kan ook rechtstreeks lid zijn. De hoogste rol telt.
54
82
55## Name
83| Rol | Lezen | Schrijven op een gewone branch | Beschermde branch | Geheimen, webhooks, leden, verwijderen |
56Choose a self-explaining name for your project.
84| --- | --- | --- | --- | --- |
85| Alleen lezen | ja | nee | nee | nee |
86| Ontwikkelaar | ja | ja | nee | nee |
87| Beheerder | ja | ja | ja | ja |
57
88
58## Description
89Een ontwikkelaar ziet geheimen niet terug. Een job krijgt ze wel als omgevingsvariabele, anders kan CI er niets mee. Wie een pipeline mag starten, kan een onbeschermd geheim dus uitlezen via `blue-ci-cd.yml`. Markeer een geheim als beschermd als het alleen op een beschermde branch mee mag, en bescherm `master`.
59Let people know what your project can do specifically. Provide context and add a link to any reference visitors might be unfamiliar with. A list of Features or a Background subsection can also be added here. If there are alternatives to your project, this is a good place to list differentiating factors.
60
90
61## Badges
91De installatiebeheerder is geen beheerder van andermans repository. Geheimen, groepen en privérepositories blijven bij de leden.
62On some READMEs, you may see small images that convey metadata, such as whether or not all the tests are passing for the project. You can use Shields to add some to your README. Many services also have instructions for adding a badge.
63
92
64## Visuals
93## CI, releases, webhooks
65Depending on what you are making, it can be a good idea to include screenshots or even a video (you'll frequently see GIFs rather than actual videos). Tools like ttygif can help, but check out Asciinema for a more sophisticated method.
66
94
67## Installation
95De specificatie staat in [docs/CI.md](docs/CI.md). Kort: `stages`, `jobs`, `image`, `script`, `needs`, `rules`, `artifacts`. Elke job is `docker run` van dat image.
68Within a particular ecosystem, there may be a common way of installing things, such as using Yarn, NuGet, or Homebrew. However, consider the possibility that whoever is reading your README is a novice and would like more guidance. Listing specific steps helps remove ambiguity and gets people to using your project as quickly as possible. If it only runs in a specific context like a particular programming language version or operating system or has dependencies that have to be installed manually, also add a Requirements subsection.
69
96
70## Usage
97Een release maakt de pipeline zelf, met `CI_JOB_TOKEN` en `CI_API_URL`. Bestanden komen uit artifacts van een eerdere job in dezelfde pipeline, niet uit de request-body.
71Use examples liberally, and show the expected output if you can. It's helpful to have inline the smallest example of usage that you can demonstrate, while providing links to more sophisticated examples if they are too long to reasonably include in the README.
72
98
73## Support
99Webhooks hebben een URL-sjabloon, eigen headers en een body-sjabloon. `{{secret.NAAM}}` en `{{event.summary}}` worden bij het versturen ingevuld. Een push kan gefilterd worden op een exacte branch of op `re:` plus een reguliere expressie. Presets: `discord`, `grok` (JSON met een `Authorization`-header) en `generic`. Een bestemming in een privénetwerk, of een naam die daarheen oplost, wordt geweigerd. Het IP van een publieke naam wordt vastgezet op het moment van verbinden, en elke redirect wordt opnieuw gekeurd.
74Tell people where they can go to for help. It can be any combination of an issue tracker, a chat room, an email address, etc.
75
100
76## Roadmap
101## Zelf bijwerken
77If you have ideas for releases in the future, it is a good idea to list them in the README.
78
102
79## Contributing
103[`blue-ci-cd.yml`](blue-ci-cd.yml) test, bouwt een statische binary, maakt een release en kopieert die via SSH naar de host. Daar is geen apart deploy-kanaal voor. De eerste binary zet je neer met het pakket. Daarna zijn de geheimen `DEPLOY_HOST`, `DEPLOY_USER`, `DEPLOY_PORT`, `DEPLOY_PATH` en `DEPLOY_SSH_KEY` genoeg, als beschermde geheimen op een beschermde branch.
80State if you are open to contributions and what your requirements are for accepting them.
81
104
82For people who want to make changes to your project, it's helpful to have some documentation on how to get started. Perhaps there is a script that they should run or some environment variables that they need to set. Make these steps explicit. These instructions could also be useful to your future self.
105## Tests
83
106
84You can also document commands to lint the code or run tests. These steps help to ensure high code quality and reduce the likelihood that the changes inadvertently break something. Having instructions for running tests is especially helpful if it requires external setup, such as starting a Selenium server for testing in a browser.
107```shell
108go test ./...
109```
85
110
86## Authors and acknowledgment
111De kern zit in `internal/access` (rollen en beschermde branches), `internal/ci` (de parser en wanneer een job mag starten) en `internal/webhook` (filters en sjablonen). `internal/server` doet een ronde met een echte `git push` en controleert dat een ontwikkelaar geen geheim kan opslaan.
87Show your appreciation to those who have contributed to the project.
88
112
89## License
113## Licentie
90For open source projects, say how it is licensed.
91
114
92## Project status
115MIT. Zie [LICENSE](LICENSE).
93If you have run out of energy or time for your project, put a note at the top of the README saying that development has slowed down or stopped completely. Someone may choose to fork your project or volunteer to step in as a maintainer or owner, allowing your project to keep going. You can also make an explicit request for maintainers.
assets/logo.svg added +55 −0
@@ -0,0 +1,55 @@
1 <?xml version="1.0" encoding="UTF-8" standalone="no"?>
2 <svg
3 width="24"
4 height="24"
5 viewBox="0 0 24 24"
6 version="1.1"
7 id="svg1"
8 sodipodi:docname="iconmonstr-star-3.svg"
9 xml:space="preserve"
10 inkscape:version="1.4.4 (dcaf3e7, 2026-05-05)"
11 xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
12 xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
13 xmlns:xlink="http://www.w3.org/1999/xlink"
14 xmlns="http://www.w3.org/2000/svg"
15 xmlns:svg="http://www.w3.org/2000/svg"><defs
16 id="defs1"><linearGradient
17 id="linearGradient1"
18 inkscape:collect="always"><stop
19 style="stop-color:#6c6dff;stop-opacity:1;"
20 offset="0"
21 id="stop1" /><stop
22 style="stop-color:#0029e7;stop-opacity:1;"
23 offset="1"
24 id="stop2" /></linearGradient><radialGradient
25 inkscape:collect="always"
26 xlink:href="#linearGradient1"
27 id="radialGradient2"
28 cx="12"
29 cy="12"
30 fx="12"
31 fy="12"
32 r="12"
33 gradientTransform="matrix(1,0,0,0.95108333,0,0.587)"
34 gradientUnits="userSpaceOnUse" /></defs><sodipodi:namedview
35 id="namedview1"
36 pagecolor="#505050"
37 bordercolor="#ffffff"
38 borderopacity="1"
39 inkscape:showpageshadow="0"
40 inkscape:pageopacity="0"
41 inkscape:pagecheckerboard="1"
42 inkscape:deskcolor="#505050"
43 showguides="false"
44 inkscape:zoom="16.854167"
45 inkscape:cx="18.719407"
46 inkscape:cy="14.150803"
47 inkscape:window-width="1920"
48 inkscape:window-height="1020"
49 inkscape:window-x="0"
50 inkscape:window-y="0"
51 inkscape:window-maximized="1"
52 inkscape:current-layer="svg1" /><path
53 id="path1"
54 style="fill:url(#radialGradient2);stroke:#fdfdfd;stroke-opacity:1;stroke-width:0.198;stroke-dasharray:none;stroke-linejoin:round"
55 d="M 12 0.58789062 L 8.7929688 7.203125 L 10.71875 9.1289062 C 11.171725 8.9758246 11.691792 9.0783281 12.052734 9.4394531 C 12.415889 9.8027921 12.51633 10.326615 12.359375 10.78125 L 14.238281 12.660156 C 14.692916 12.503385 15.217108 12.605227 15.580078 12.96875 C 16.087277 13.475949 16.087277 14.29712 15.580078 14.804688 C 15.07251 15.312071 14.251894 15.312071 13.744141 14.804688 C 13.362726 14.422904 13.267465 13.862521 13.460938 13.392578 L 11.708984 11.640625 L 11.708984 16.251953 C 11.832556 16.313183 11.949818 16.393179 12.052734 16.496094 C 12.559933 17.003294 12.559933 17.826232 12.052734 18.333984 C 11.545534 18.841 10.721675 18.841 10.214844 18.333984 C 9.7076436 17.826047 9.7076436 17.00311 10.214844 16.496094 C 10.34026 16.370863 10.485699 16.276337 10.640625 16.212891 L 10.640625 11.560547 C 10.485699 11.4971 10.34063 11.403499 10.214844 11.277344 C 9.8306627 10.893348 9.7385689 10.329209 9.9355469 9.8574219 L 8.2460938 8.1660156 L 0 9.3066406 L 6.0644531 15.134766 L 4.5820312 23.412109 L 12 19.445312 L 19.416016 23.412109 L 17.935547 15.134766 L 24 9.3066406 L 15.667969 8.1542969 L 12 0.58789062 z " /></svg>
@@ -0,0 +1,55 @@
1<?xml version="1.0" encoding="UTF-8" standalone="no"?>
2<svg
3 width="24"
4 height="24"
5 viewBox="0 0 24 24"
6 version="1.1"
7 id="svg1"
8 sodipodi:docname="iconmonstr-star-3.svg"
9 xml:space="preserve"
10 inkscape:version="1.4.4 (dcaf3e7, 2026-05-05)"
11 xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
12 xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
13 xmlns:xlink="http://www.w3.org/1999/xlink"
14 xmlns="http://www.w3.org/2000/svg"
15 xmlns:svg="http://www.w3.org/2000/svg"><defs
16 id="defs1"><linearGradient
17 id="linearGradient1"
18 inkscape:collect="always"><stop
19 style="stop-color:#6c6dff;stop-opacity:1;"
20 offset="0"
21 id="stop1" /><stop
22 style="stop-color:#0029e7;stop-opacity:1;"
23 offset="1"
24 id="stop2" /></linearGradient><radialGradient
25 inkscape:collect="always"
26 xlink:href="#linearGradient1"
27 id="radialGradient2"
28 cx="12"
29 cy="12"
30 fx="12"
31 fy="12"
32 r="12"
33 gradientTransform="matrix(1,0,0,0.95108333,0,0.587)"
34 gradientUnits="userSpaceOnUse" /></defs><sodipodi:namedview
35 id="namedview1"
36 pagecolor="#505050"
37 bordercolor="#ffffff"
38 borderopacity="1"
39 inkscape:showpageshadow="0"
40 inkscape:pageopacity="0"
41 inkscape:pagecheckerboard="1"
42 inkscape:deskcolor="#505050"
43 showguides="false"
44 inkscape:zoom="16.854167"
45 inkscape:cx="18.719407"
46 inkscape:cy="14.150803"
47 inkscape:window-width="1920"
48 inkscape:window-height="1020"
49 inkscape:window-x="0"
50 inkscape:window-y="0"
51 inkscape:window-maximized="1"
52 inkscape:current-layer="svg1" /><path
53 id="path1"
54 style="fill:url(#radialGradient2);stroke:#fdfdfd;stroke-opacity:1;stroke-width:0.198;stroke-dasharray:none;stroke-linejoin:round"
55 d="M 12 0.58789062 L 8.7929688 7.203125 L 10.71875 9.1289062 C 11.171725 8.9758246 11.691792 9.0783281 12.052734 9.4394531 C 12.415889 9.8027921 12.51633 10.326615 12.359375 10.78125 L 14.238281 12.660156 C 14.692916 12.503385 15.217108 12.605227 15.580078 12.96875 C 16.087277 13.475949 16.087277 14.29712 15.580078 14.804688 C 15.07251 15.312071 14.251894 15.312071 13.744141 14.804688 C 13.362726 14.422904 13.267465 13.862521 13.460938 13.392578 L 11.708984 11.640625 L 11.708984 16.251953 C 11.832556 16.313183 11.949818 16.393179 12.052734 16.496094 C 12.559933 17.003294 12.559933 17.826232 12.052734 18.333984 C 11.545534 18.841 10.721675 18.841 10.214844 18.333984 C 9.7076436 17.826047 9.7076436 17.00311 10.214844 16.496094 C 10.34026 16.370863 10.485699 16.276337 10.640625 16.212891 L 10.640625 11.560547 C 10.485699 11.4971 10.34063 11.403499 10.214844 11.277344 C 9.8306627 10.893348 9.7385689 10.329209 9.9355469 9.8574219 L 8.2460938 8.1660156 L 0 9.3066406 L 6.0644531 15.134766 L 4.5820312 23.412109 L 12 19.445312 L 19.416016 23.412109 L 17.935547 15.134766 L 24 9.3066406 L 15.667969 8.1542969 L 12 0.58789062 z " /></svg>
blue-ci-cd.yml added +58 −0
@@ -0,0 +1,58 @@
1 # Pipeline waarmee BlueGit zichzelf bouwt, publiceert en uitrolt.
2 # Geen speciale behandeling: dezelfde jobs als elke andere repository.
3 # Zet op de repository de geheimen DEPLOY_HOST, DEPLOY_USER, DEPLOY_PORT,
4 # DEPLOY_PATH en DEPLOY_SSH_KEY. Markeer ze als beschermd, en bescherm de
5 # branch master. Een regel voor main blijft staan, zodat een oude
6 # branch nog kan uitrollen. Dan komen die geheimen alleen mee op een
7 # beschermde branch.
8
9 stages: [test, build, release, deploy]
10
11 variables:
12 CGO_ENABLED: "0"
13
14 jobs:
15 test:
16 stage: test
17 image: golang:1.22
18 script:
19 - go test ./...
20
21 build:
22 stage: build
23 image: golang:1.22
24 needs: [test]
25 script:
26 - go build -trimpath -ldflags="-s -w" -o bluegit ./cmd/bluegit
27 artifacts:
28 paths: [bluegit]
29 expire_in: 14d
30
31 release:
32 stage: release
33 image: curlimages/curl:8.11.0
34 needs: [build]
35 rules:
36 - if: $CI_COMMIT_BRANCH == "master"
37 - if: $CI_COMMIT_BRANCH == "main"
38 script:
39 - >-
40 curl -fsS -X POST "$CI_API_URL/repos/$CI_PROJECT_PATH/releases"
41 -H "Authorization: Bearer $CI_JOB_TOKEN"
42 -H "Content-Type: application/json"
43 -d "{\"tag\":\"v${CI_PIPELINE_ID}\",\"commit\":\"${CI_COMMIT_SHA}\",\"name\":\"BlueGit ${CI_PIPELINE_ID}\",\"assets\":[{\"job\":\"build\",\"path\":\"bluegit\",\"name\":\"bluegit\"}]}"
44
45 deploy:
46 stage: deploy
47 image: alpine:3.20
48 needs: [build, release]
49 rules:
50 - if: $CI_COMMIT_BRANCH == "master"
51 - if: $CI_COMMIT_BRANCH == "main"
52 script:
53 - apk add --no-cache openssh-client
54 - mkdir -p ~/.ssh && chmod 700 ~/.ssh
55 - printf '%s\n' "$DEPLOY_SSH_KEY" > ~/.ssh/id_ed25519
56 - chmod 600 ~/.ssh/id_ed25519
57 - scp -i ~/.ssh/id_ed25519 -P "$DEPLOY_PORT" -o StrictHostKeyChecking=accept-new bluegit "$DEPLOY_USER@$DEPLOY_HOST:$DEPLOY_PATH.new"
58 - ssh -i ~/.ssh/id_ed25519 -p "$DEPLOY_PORT" -o StrictHostKeyChecking=accept-new "$DEPLOY_USER@$DEPLOY_HOST" "mv '$DEPLOY_PATH.new' '$DEPLOY_PATH' && chmod 755 '$DEPLOY_PATH' && systemctl restart bluegit"
@@ -0,0 +1,58 @@
1# Pipeline waarmee BlueGit zichzelf bouwt, publiceert en uitrolt.
2# Geen speciale behandeling: dezelfde jobs als elke andere repository.
3# Zet op de repository de geheimen DEPLOY_HOST, DEPLOY_USER, DEPLOY_PORT,
4# DEPLOY_PATH en DEPLOY_SSH_KEY. Markeer ze als beschermd, en bescherm de
5# branch master. Een regel voor main blijft staan, zodat een oude
6# branch nog kan uitrollen. Dan komen die geheimen alleen mee op een
7# beschermde branch.
8
9stages: [test, build, release, deploy]
10
11variables:
12 CGO_ENABLED: "0"
13
14jobs:
15 test:
16 stage: test
17 image: golang:1.22
18 script:
19 - go test ./...
20
21 build:
22 stage: build
23 image: golang:1.22
24 needs: [test]
25 script:
26 - go build -trimpath -ldflags="-s -w" -o bluegit ./cmd/bluegit
27 artifacts:
28 paths: [bluegit]
29 expire_in: 14d
30
31 release:
32 stage: release
33 image: curlimages/curl:8.11.0
34 needs: [build]
35 rules:
36 - if: $CI_COMMIT_BRANCH == "master"
37 - if: $CI_COMMIT_BRANCH == "main"
38 script:
39 - >-
40 curl -fsS -X POST "$CI_API_URL/repos/$CI_PROJECT_PATH/releases"
41 -H "Authorization: Bearer $CI_JOB_TOKEN"
42 -H "Content-Type: application/json"
43 -d "{\"tag\":\"v${CI_PIPELINE_ID}\",\"commit\":\"${CI_COMMIT_SHA}\",\"name\":\"BlueGit ${CI_PIPELINE_ID}\",\"assets\":[{\"job\":\"build\",\"path\":\"bluegit\",\"name\":\"bluegit\"}]}"
44
45 deploy:
46 stage: deploy
47 image: alpine:3.20
48 needs: [build, release]
49 rules:
50 - if: $CI_COMMIT_BRANCH == "master"
51 - if: $CI_COMMIT_BRANCH == "main"
52 script:
53 - apk add --no-cache openssh-client
54 - mkdir -p ~/.ssh && chmod 700 ~/.ssh
55 - printf '%s\n' "$DEPLOY_SSH_KEY" > ~/.ssh/id_ed25519
56 - chmod 600 ~/.ssh/id_ed25519
57 - scp -i ~/.ssh/id_ed25519 -P "$DEPLOY_PORT" -o StrictHostKeyChecking=accept-new bluegit "$DEPLOY_USER@$DEPLOY_HOST:$DEPLOY_PATH.new"
58 - ssh -i ~/.ssh/id_ed25519 -p "$DEPLOY_PORT" -o StrictHostKeyChecking=accept-new "$DEPLOY_USER@$DEPLOY_HOST" "mv '$DEPLOY_PATH.new' '$DEPLOY_PATH' && chmod 755 '$DEPLOY_PATH' && systemctl restart bluegit"
cmd/bluegit/main.go added +281 −0
@@ -0,0 +1,281 @@
1 package main
2
3 import (
4 "context"
5 "crypto/rand"
6 "flag"
7 "fmt"
8 "log/slog"
9 "net/http"
10 "os"
11 "os/signal"
12 "path/filepath"
13 "strings"
14 "syscall"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/auth"
19 "gitlab.com/Timfa/bluegit/internal/config"
20 "gitlab.com/Timfa/bluegit/internal/gitrepo"
21 "gitlab.com/Timfa/bluegit/internal/runner"
22 "gitlab.com/Timfa/bluegit/internal/server"
23 "gitlab.com/Timfa/bluegit/internal/sshd"
24 "gitlab.com/Timfa/bluegit/internal/state"
25 "gitlab.com/Timfa/bluegit/internal/store"
26 )
27
28 func main() {
29 if len(os.Args) < 2 {
30 usage()
31 os.Exit(2)
32 }
33 switch os.Args[1] {
34 case "serve":
35 if err := serve(os.Args[2:]); err != nil {
36 fmt.Fprintln(os.Stderr, err)
37 os.Exit(1)
38 }
39 case "hook":
40 hook(os.Args[2:])
41 case "token":
42 if err := tokenCmd(os.Args[2:]); err != nil {
43 fmt.Fprintln(os.Stderr, err)
44 os.Exit(1)
45 }
46 case "example-config":
47 fmt.Print(config.Example())
48 default:
49 usage()
50 os.Exit(2)
51 }
52 }
53
54 func usage() {
55 fmt.Fprintf(os.Stderr, `BlueGit
56
57 bluegit serve --config /etc/bluegit/config.yml
58 bluegit hook pre-receive
59 bluegit token create --config /etc/bluegit/config.yml --user tim --name laptop
60 bluegit example-config
61 `)
62 }
63
64 func serve(args []string) error {
65 fs := flag.NewFlagSet("serve", flag.ExitOnError)
66 configPath := fs.String("config", "", "pad naar config.yml")
67 _ = fs.Parse(args)
68 cfg, err := loadConfig(*configPath)
69 if err != nil {
70 return err
71 }
72 log := slog.New(slog.NewTextHandler(os.Stdout, nil))
73 if err := os.MkdirAll(cfg.StatePath, 0o750); err != nil {
74 return err
75 }
76 key, err := loadKey(filepath.Join(cfg.StatePath, "secret.key"))
77 if err != nil {
78 return err
79 }
80 st, err := store.Open(filepath.Join(cfg.StatePath, "bluegit.db"), key)
81 if err != nil {
82 return err
83 }
84 defer st.Close()
85 exe, err := os.Executable()
86 if err != nil {
87 return err
88 }
89 if cfg.Git.HookBinary != "" {
90 exe = cfg.Git.HookBinary
91 }
92 dataPath := resolveStorage(cfg, log)
93 var provider auth.Provider
94 dev := cfg.Auth.Mode == "dev"
95 if dev {
96 provider = auth.Dev{Username: cfg.Auth.DevUser, AuthID: cfg.Auth.DevAuthID}
97 log.Warn("auth.mode dev staat aan; doe dit niet op git.timfalken.com")
98 } else {
99 provider = auth.NewTimFalken(cfg.Auth.BaseURL, cfg.Auth.ClientID, cfg.Auth.ClientSecret, cfg.Auth.UserAgent)
100 }
101 ctx, stop := signal.NotifyContext(context.Background(), syscall.SIGINT, syscall.SIGTERM)
102 defer stop()
103 srv := &server.Server{
104 Cfg: cfg, Store: st, Auth: provider, Dev: dev, Git: cfg.Git.Binary, HookBin: exe, Log: log,
105 StateDir: cfg.StatePath,
106 }
107 var rn *runner.Runner
108 if cfg.CI.Enabled {
109 rn = &runner.Runner{
110 Store: st, GitBin: cfg.Git.Binary, Docker: cfg.CI.Docker, Storage: dataPath,
111 BaseURL: cfg.BaseURL, Network: cfg.CI.Network, Timeout: time.Duration(cfg.CI.TimeoutSec) * time.Second,
112 Log: log, OnEvent: srv.Dispatch,
113 }
114 srv.Runner = rn
115 go rn.Loop(ctx, cfg.CI.Concurrency)
116 }
117 var sh *sshd.Server
118 if cfg.SSH.Enabled {
119 sh = &sshd.Server{
120 Listen: cfg.SSH.Listen, Store: st, GitBin: cfg.Git.Binary, Storage: dataPath,
121 HostKey: filepath.Join(cfg.StatePath, "ssh", "host_ed25519"), Log: log,
122 OnPush: srv.AfterPush,
123 }
124 go func() {
125 if err := sh.Run(ctx); err != nil {
126 log.Error("ssh", "err", err)
127 }
128 }()
129 }
130 srv.AfterStorage = func(path string) {
131 if rn != nil {
132 rn.SetStorage(path)
133 }
134 if sh != nil {
135 sh.SetStorage(path)
136 }
137 }
138 srv.AdoptStorage(dataPath)
139 srv.RefreshHooks()
140 httpSrv := &http.Server{Addr: cfg.Listen, Handler: srv.Handler(), ReadHeaderTimeout: 10 * time.Second}
141 go func() {
142 <-ctx.Done()
143 shut, cancel := context.WithTimeout(context.Background(), 10*time.Second)
144 defer cancel()
145 _ = httpSrv.Shutdown(shut)
146 }()
147 log.Info("BlueGit luistert", "addr", cfg.Listen, "base", cfg.BaseURL)
148 if err := httpSrv.ListenAndServe(); err != nil && err != http.ErrServerClosed {
149 return err
150 }
151 return nil
152 }
153
154 func hook(args []string) {
155 if len(args) != 1 || args[0] != "pre-receive" {
156 fmt.Fprintln(os.Stderr, "gebruik: bluegit hook pre-receive")
157 os.Exit(2)
158 }
159 var patterns []string
160 if raw := os.Getenv("BLUEGIT_PROTECTED"); raw != "" {
161 for _, p := range splitLines(raw) {
162 patterns = append(patterns, p)
163 }
164 }
165 role := access.Role(os.Getenv("BLUEGIT_ROLE"))
166 if err := gitrepo.EvaluatePush(role, patterns, os.Stdin); err != nil {
167 fmt.Fprintln(os.Stderr, err.Error())
168 os.Exit(1)
169 }
170 }
171
172 func tokenCmd(args []string) error {
173 fs := flag.NewFlagSet("token", flag.ExitOnError)
174 configPath := fs.String("config", "", "pad naar config.yml")
175 user := fs.String("user", "", "gebruikersnaam")
176 name := fs.String("name", "cli", "naam van het token")
177 if len(args) == 0 || args[0] != "create" {
178 return fmt.Errorf("gebruik: bluegit token create --config … --user … --name …")
179 }
180 _ = fs.Parse(args[1:])
181 cfg, err := loadConfig(*configPath)
182 if err != nil {
183 return err
184 }
185 if err := os.MkdirAll(cfg.StatePath, 0o750); err != nil {
186 return err
187 }
188 key, err := loadKey(filepath.Join(cfg.StatePath, "secret.key"))
189 if err != nil {
190 return err
191 }
192 st, err := store.Open(filepath.Join(cfg.StatePath, "bluegit.db"), key)
193 if err != nil {
194 return err
195 }
196 defer st.Close()
197 u, err := st.UserByUsername(context.Background(), *user)
198 if err != nil {
199 return fmt.Errorf("gebruiker %s heeft nog niet aangemeld", *user)
200 }
201 plain, err := st.CreateToken(context.Background(), u.ID, *name)
202 if err != nil {
203 return err
204 }
205 fmt.Println(plain)
206 return nil
207 }
208
209 func resolveStorage(cfg config.Config, log *slog.Logger) string {
210 saved, err := state.Read(cfg.StatePath)
211 if err != nil {
212 log.Error("opslagpad lezen", "err", err)
213 return ""
214 }
215 path := strings.TrimSpace(saved)
216 if path == "" {
217 path = strings.TrimSpace(cfg.StoragePath)
218 }
219 if path == "" {
220 log.Info("geen opslagpad; de beheerder kiest het in de webinterface")
221 return ""
222 }
223 if filepath.Clean(path) == filepath.Clean(cfg.StatePath) {
224 log.Warn("opslagpad is de state-map; kies de datadisk in de webinterface", "path", path)
225 return ""
226 }
227 if _, err := state.Inspect(path); err != nil {
228 log.Warn("opslagpad niet bruikbaar", "path", path, "err", err)
229 return ""
230 }
231 return path
232 }
233
234 func loadConfig(path string) (config.Config, error) {
235 if path == "" {
236 path = os.Getenv("BLUEGIT_CONFIG")
237 }
238 if path == "" {
239 if _, err := os.Stat("bluegit.yml"); err == nil {
240 path = "bluegit.yml"
241 } else {
242 path = "/etc/bluegit/config.yml"
243 }
244 }
245 return config.Load(path)
246 }
247
248 func loadKey(path string) ([]byte, error) {
249 if b, err := os.ReadFile(path); err == nil {
250 if len(b) != 32 {
251 return nil, fmt.Errorf("%s moet 32 bytes zijn", path)
252 }
253 return b, nil
254 }
255 if err := os.MkdirAll(filepath.Dir(path), 0o750); err != nil {
256 return nil, err
257 }
258 b := make([]byte, 32)
259 if _, err := rand.Read(b); err != nil {
260 return nil, err
261 }
262 if err := os.WriteFile(path, b, 0o600); err != nil {
263 return nil, err
264 }
265 return b, nil
266 }
267
268 func splitLines(s string) []string {
269 var out []string
270 start := 0
271 for i := 0; i <= len(s); i++ {
272 if i == len(s) || s[i] == '\n' {
273 part := s[start:i]
274 if part != "" {
275 out = append(out, part)
276 }
277 start = i + 1
278 }
279 }
280 return out
281 }
@@ -0,0 +1,281 @@
1package main
2
3import (
4 "context"
5 "crypto/rand"
6 "flag"
7 "fmt"
8 "log/slog"
9 "net/http"
10 "os"
11 "os/signal"
12 "path/filepath"
13 "strings"
14 "syscall"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/auth"
19 "gitlab.com/Timfa/bluegit/internal/config"
20 "gitlab.com/Timfa/bluegit/internal/gitrepo"
21 "gitlab.com/Timfa/bluegit/internal/runner"
22 "gitlab.com/Timfa/bluegit/internal/server"
23 "gitlab.com/Timfa/bluegit/internal/sshd"
24 "gitlab.com/Timfa/bluegit/internal/state"
25 "gitlab.com/Timfa/bluegit/internal/store"
26)
27
28func main() {
29 if len(os.Args) < 2 {
30 usage()
31 os.Exit(2)
32 }
33 switch os.Args[1] {
34 case "serve":
35 if err := serve(os.Args[2:]); err != nil {
36 fmt.Fprintln(os.Stderr, err)
37 os.Exit(1)
38 }
39 case "hook":
40 hook(os.Args[2:])
41 case "token":
42 if err := tokenCmd(os.Args[2:]); err != nil {
43 fmt.Fprintln(os.Stderr, err)
44 os.Exit(1)
45 }
46 case "example-config":
47 fmt.Print(config.Example())
48 default:
49 usage()
50 os.Exit(2)
51 }
52}
53
54func usage() {
55 fmt.Fprintf(os.Stderr, `BlueGit
56
57 bluegit serve --config /etc/bluegit/config.yml
58 bluegit hook pre-receive
59 bluegit token create --config /etc/bluegit/config.yml --user tim --name laptop
60 bluegit example-config
61`)
62}
63
64func serve(args []string) error {
65 fs := flag.NewFlagSet("serve", flag.ExitOnError)
66 configPath := fs.String("config", "", "pad naar config.yml")
67 _ = fs.Parse(args)
68 cfg, err := loadConfig(*configPath)
69 if err != nil {
70 return err
71 }
72 log := slog.New(slog.NewTextHandler(os.Stdout, nil))
73 if err := os.MkdirAll(cfg.StatePath, 0o750); err != nil {
74 return err
75 }
76 key, err := loadKey(filepath.Join(cfg.StatePath, "secret.key"))
77 if err != nil {
78 return err
79 }
80 st, err := store.Open(filepath.Join(cfg.StatePath, "bluegit.db"), key)
81 if err != nil {
82 return err
83 }
84 defer st.Close()
85 exe, err := os.Executable()
86 if err != nil {
87 return err
88 }
89 if cfg.Git.HookBinary != "" {
90 exe = cfg.Git.HookBinary
91 }
92 dataPath := resolveStorage(cfg, log)
93 var provider auth.Provider
94 dev := cfg.Auth.Mode == "dev"
95 if dev {
96 provider = auth.Dev{Username: cfg.Auth.DevUser, AuthID: cfg.Auth.DevAuthID}
97 log.Warn("auth.mode dev staat aan; doe dit niet op git.timfalken.com")
98 } else {
99 provider = auth.NewTimFalken(cfg.Auth.BaseURL, cfg.Auth.ClientID, cfg.Auth.ClientSecret, cfg.Auth.UserAgent)
100 }
101 ctx, stop := signal.NotifyContext(context.Background(), syscall.SIGINT, syscall.SIGTERM)
102 defer stop()
103 srv := &server.Server{
104 Cfg: cfg, Store: st, Auth: provider, Dev: dev, Git: cfg.Git.Binary, HookBin: exe, Log: log,
105 StateDir: cfg.StatePath,
106 }
107 var rn *runner.Runner
108 if cfg.CI.Enabled {
109 rn = &runner.Runner{
110 Store: st, GitBin: cfg.Git.Binary, Docker: cfg.CI.Docker, Storage: dataPath,
111 BaseURL: cfg.BaseURL, Network: cfg.CI.Network, Timeout: time.Duration(cfg.CI.TimeoutSec) * time.Second,
112 Log: log, OnEvent: srv.Dispatch,
113 }
114 srv.Runner = rn
115 go rn.Loop(ctx, cfg.CI.Concurrency)
116 }
117 var sh *sshd.Server
118 if cfg.SSH.Enabled {
119 sh = &sshd.Server{
120 Listen: cfg.SSH.Listen, Store: st, GitBin: cfg.Git.Binary, Storage: dataPath,
121 HostKey: filepath.Join(cfg.StatePath, "ssh", "host_ed25519"), Log: log,
122 OnPush: srv.AfterPush,
123 }
124 go func() {
125 if err := sh.Run(ctx); err != nil {
126 log.Error("ssh", "err", err)
127 }
128 }()
129 }
130 srv.AfterStorage = func(path string) {
131 if rn != nil {
132 rn.SetStorage(path)
133 }
134 if sh != nil {
135 sh.SetStorage(path)
136 }
137 }
138 srv.AdoptStorage(dataPath)
139 srv.RefreshHooks()
140 httpSrv := &http.Server{Addr: cfg.Listen, Handler: srv.Handler(), ReadHeaderTimeout: 10 * time.Second}
141 go func() {
142 <-ctx.Done()
143 shut, cancel := context.WithTimeout(context.Background(), 10*time.Second)
144 defer cancel()
145 _ = httpSrv.Shutdown(shut)
146 }()
147 log.Info("BlueGit luistert", "addr", cfg.Listen, "base", cfg.BaseURL)
148 if err := httpSrv.ListenAndServe(); err != nil && err != http.ErrServerClosed {
149 return err
150 }
151 return nil
152}
153
154func hook(args []string) {
155 if len(args) != 1 || args[0] != "pre-receive" {
156 fmt.Fprintln(os.Stderr, "gebruik: bluegit hook pre-receive")
157 os.Exit(2)
158 }
159 var patterns []string
160 if raw := os.Getenv("BLUEGIT_PROTECTED"); raw != "" {
161 for _, p := range splitLines(raw) {
162 patterns = append(patterns, p)
163 }
164 }
165 role := access.Role(os.Getenv("BLUEGIT_ROLE"))
166 if err := gitrepo.EvaluatePush(role, patterns, os.Stdin); err != nil {
167 fmt.Fprintln(os.Stderr, err.Error())
168 os.Exit(1)
169 }
170}
171
172func tokenCmd(args []string) error {
173 fs := flag.NewFlagSet("token", flag.ExitOnError)
174 configPath := fs.String("config", "", "pad naar config.yml")
175 user := fs.String("user", "", "gebruikersnaam")
176 name := fs.String("name", "cli", "naam van het token")
177 if len(args) == 0 || args[0] != "create" {
178 return fmt.Errorf("gebruik: bluegit token create --config … --user … --name …")
179 }
180 _ = fs.Parse(args[1:])
181 cfg, err := loadConfig(*configPath)
182 if err != nil {
183 return err
184 }
185 if err := os.MkdirAll(cfg.StatePath, 0o750); err != nil {
186 return err
187 }
188 key, err := loadKey(filepath.Join(cfg.StatePath, "secret.key"))
189 if err != nil {
190 return err
191 }
192 st, err := store.Open(filepath.Join(cfg.StatePath, "bluegit.db"), key)
193 if err != nil {
194 return err
195 }
196 defer st.Close()
197 u, err := st.UserByUsername(context.Background(), *user)
198 if err != nil {
199 return fmt.Errorf("gebruiker %s heeft nog niet aangemeld", *user)
200 }
201 plain, err := st.CreateToken(context.Background(), u.ID, *name)
202 if err != nil {
203 return err
204 }
205 fmt.Println(plain)
206 return nil
207}
208
209func resolveStorage(cfg config.Config, log *slog.Logger) string {
210 saved, err := state.Read(cfg.StatePath)
211 if err != nil {
212 log.Error("opslagpad lezen", "err", err)
213 return ""
214 }
215 path := strings.TrimSpace(saved)
216 if path == "" {
217 path = strings.TrimSpace(cfg.StoragePath)
218 }
219 if path == "" {
220 log.Info("geen opslagpad; de beheerder kiest het in de webinterface")
221 return ""
222 }
223 if filepath.Clean(path) == filepath.Clean(cfg.StatePath) {
224 log.Warn("opslagpad is de state-map; kies de datadisk in de webinterface", "path", path)
225 return ""
226 }
227 if _, err := state.Inspect(path); err != nil {
228 log.Warn("opslagpad niet bruikbaar", "path", path, "err", err)
229 return ""
230 }
231 return path
232}
233
234func loadConfig(path string) (config.Config, error) {
235 if path == "" {
236 path = os.Getenv("BLUEGIT_CONFIG")
237 }
238 if path == "" {
239 if _, err := os.Stat("bluegit.yml"); err == nil {
240 path = "bluegit.yml"
241 } else {
242 path = "/etc/bluegit/config.yml"
243 }
244 }
245 return config.Load(path)
246}
247
248func loadKey(path string) ([]byte, error) {
249 if b, err := os.ReadFile(path); err == nil {
250 if len(b) != 32 {
251 return nil, fmt.Errorf("%s moet 32 bytes zijn", path)
252 }
253 return b, nil
254 }
255 if err := os.MkdirAll(filepath.Dir(path), 0o750); err != nil {
256 return nil, err
257 }
258 b := make([]byte, 32)
259 if _, err := rand.Read(b); err != nil {
260 return nil, err
261 }
262 if err := os.WriteFile(path, b, 0o600); err != nil {
263 return nil, err
264 }
265 return b, nil
266}
267
268func splitLines(s string) []string {
269 var out []string
270 start := 0
271 for i := 0; i <= len(s); i++ {
272 if i == len(s) || s[i] == '\n' {
273 part := s[start:i]
274 if part != "" {
275 out = append(out, part)
276 }
277 start = i + 1
278 }
279 }
280 return out
281}
docs/ARCHITECTURE.md added +93 −0
@@ -0,0 +1,93 @@
1 # Architectuur
2
3 BlueGit is één proces. Het bedient de website, de git-HTTP-server, de API en (als het aanstaat) de SSH-listener. Een tweede goroutine plant CI-jobs. Metadata staat in SQLite. Git-objecten staan in bare repositories op de datadisk.
4
5 ```text
6 browser ──HTTPS──▶ ingress ──HTTP──▶ bluegit (web + smart HTTP + API)
7 git ──HTTPS──▶ ingress ──HTTP──▶ bluegit ──▶ git http-backend ──▶ pre-receive hook
8 git ──SSH:22─▶ ingress ──TCP:2222──▶ bluegit ──▶ git-receive-pack ──▶ dezelfde hook
9 bluegit ──bearer──▶ auth.timfalken.com
10 bluegit ──docker run──▶ jobcontainer
11 jobcontainer ──CI_JOB_TOKEN──▶ API van bluegit (release)
12 jobcontainer ──SSH-geheim──▶ de host (deploy, gewone SSH)
13 ```
14
15 De ingress staat op een andere machine en doet TLS en SSH-forwarding. BlueGit luistert plain HTTP op `listen`. Clone-URL's komen uit `base_url` en uit `ssh.public_host` / `ssh.public_port`, niet uit de binnenkomende request. `X-Forwarded-For` en `X-Real-IP` gelden alleen als de directe verbinding van een adres in `trusted_proxies` komt. Het voorbeeld staat in [INGRESS.md](INGRESS.md).
16
17 ## Waarom deze vorm
18
19 De mini-PC moet één ding draaien dat je kunt vervangen door een nieuwe binary. Go levert die binary zonder runtime ernaast. SQLite hoeft geen tweede dienst. De git-binary is toch al nodig voor hooks en merges; smart HTTP gaat daarom via `git http-backend` in plaats van een eigen implementatie van het pack-protocol.
20
21 Docker is alleen de jobgrens die de eis stelt. BlueGit mount de Docker-socket niet in de job. Een job die de host wil wijzigen, doet dat via SSH met een geheim, net als elke andere repository.
22
23 ## Schijf
24
25 Twee mappen. De state-map is klein en staat vast, standaard `/var/lib/bluegit` (`state_path`, de `StateDirectory` van systemd). Daar staan de database, `secret.key` en de SSH-hostkey, plus het bestand `storage_path` zodra de beheerder een datadisk heeft gekozen. Zonder dat bestand, en zonder een expliciet `storage_path` in de configuratie, is er geen datadisk. De eerste aangemelde gebruiker kiest die in `/setup`. Het pad moet bestaan, beschrijfbaar zijn en minstens 1 GiB vrij hebben. Git en CI antwoorden tot die tijd met een melding.
26
27 De datadisk zelf heeft geen standaardpad. Wijzigen mag later in hetzelfde scherm. BlueGit verhuist de bestanden niet; oude repositories blijven op de oude plek staan en worden daar niet meer gezocht.
28
29 Onder `ProtectSystem=strict` mag het proces alleen in de state-map schrijven, tot een drop-in `ReadWritePaths` het gekozen pad toevoegt. Die drop-in moet er zijn vóór het opslaan, anders faalt de schrijftest. Voorbeeld: `packaging/storage.conf`.
30
31 ```text
32 /var/lib/bluegit/bluegit.db
33 /var/lib/bluegit/secret.key
34 /var/lib/bluegit/storage_path
35 /var/lib/bluegit/ssh/host_ed25519
36 <datadisk>/repos/eigenaar/naam.git
37 <datadisk>/artifacts/job-id/…
38 <datadisk>/releases/eigenaar/naam/tag/…
39 <datadisk>/work/pipeline/job/
40 ```
41
42 Geheimen in de database zijn versleuteld. Sessietokens van de auth-server staan als tekst in SQLite; de bestandsmachtiging van de database is de grens. Versleutelen van die sessies staat op de roadmap.
43
44 ## Auth
45
46 De interface `auth.Provider` heeft `AuthorizeURL`, `Exchange`, `Extend` en `Logout`. `TimFalken` praat met auth.timfalken.com. `Dev` vult dezelfde interface lokaal, zonder wachtwoord, en mag niet aan op het productiedomein.
47
48 Na de code-wissel bewaart BlueGit het bearer-token in de sessie. Korter dan zes uur voor het einde wordt `POST /api/session/extend` aangeroepen. Afmelden trekt het token in met `POST /api/logout`.
49
50 Git en de API gebruiken een apart toegangstoken (`bg_…`) of, alleen tijdens een job, een job-token (`bgj_…`). Dat zijn geen wachtwoorden: ze worden één keer getoond, als hash bewaard, en zijn in te trekken. Het OAuth-token leeft 24 uur en is een slechte git-credential.
51
52 Details en de eisen van de auth-server staan in [AUTH.md](AUTH.md).
53
54 ## Rechten
55
56 `internal/access` is bewust los van HTTP en SQL. `Resolve` kiest de hoogste rol uit persoonlijke eigenaar, groepslid en rechtstreeks lid. `AuthorizeUpdate` keurt een pre-receive-regel goed. De hook is die functie, aangeroepen als `bluegit hook pre-receive`, met de rol en de patronen in de omgeving. Zonder die omgeving weigert de hook, zodat een push om de server heen niet slaagt.
57
58 De eerste aangemelde gebruiker is installatiebeheerder. `is_admin` van de auth-server wordt opgeslagen en geeft die vlag niet. Installatiebeheer geeft geen lidmaatschap van andermans repositories of groepen en geen inzage in hun geheimen. Het scherm `/setup` hoort bij die vlag: daar staat alleen het pad van de datadisk.
59
60 ## Web
61
62 De pagina's zijn serverside HTML uit de binary. De router is de standaard `ServeMux` van Go 1.22. Een repository staat op `/{eigenaar}/{naam}`. Git staat op `/{eigenaar}/{naam}.git`. Vaste paden (`/login`, `/groups`, `/settings`, `/api`) winnen van die wildcard.
63
64 Formulieren sturen een CSRF-token uit de sessie mee. De API gebruikt een bearer-token en geen CSRF.
65
66 ## Push naar pipeline
67
68 Na een geslaagde smart-HTTP-push of SSH-push vergelijkt BlueGit de refs. Voor elke bijgewerkte branch leest het `blue-ci-cd.yml` op die commit. Ontbreekt het bestand, dan gebeurt er niets. Is het ongeldig, dan komt er een mislukte pipeline met de fout in het log, zodat de push zelf niet blokkeert. Jobs waarvan de `rules` niet kloppen, worden niet aangemaakt.
69
70 De runner zet een job op `running`, kloont de commit naar een werkmap, haalt artifacts van eerdere jobs binnen, en start:
71
72 ```text
73 docker run --rm --network <ci.network> -e NAAM …
74 -v werkmap:/workspace --entrypoint sh IMAGE /workspace/.bluegit-job.sh
75 ```
76
77 `-e NAAM` zonder waarde laat Docker de variabele uit de omgeving van BlueGit overnemen. Daardoor blijft een meerregelige SSH-sleutel heel, en staat de waarde niet in de proceslijst. Het netwerk van de container is het gewone Docker-netwerk, niet het hostnetwerk.
78
79 `CI_JOB_TOKEN` hoort bij die ene lopende job. De release-API eist dat het token bij deze repository hoort en dat de job nog loopt. Assets moeten al als artifact van een geslaagde job in dezelfde pipeline bestaan.
80
81 ## Webhooks
82
83 Een gebeurtenis gaat naar de webhooks van de repository en, als de repository van een groep is, ook naar die van de groep. Een repository-webhook ziet repositorygeheimen. Een groep-webhook ziet alleen groepgeheimen. Een beschermd geheim gaat mee als de branch van de gebeurtenis beschermd is.
84
85 Het branchfilter geldt alleen voor `push`. Andere gebeurtenissen negeren het. Een onbekend geheim of veld in het sjabloon is een fout en er gaat niets uit, zodat er geen webhook vertrekt met een leeg token.
86
87 De bestemming wordt bij het verbinden opgelost. Privébereiken (RFC1918, loopback, link-local, CGNAT, ULA en de IPv6-equivalenten, plus multicast en gereserveerde adressen) worden geweigerd, ook als maar één DNS-antwoord daarheen wijst. Het gekozen publieke IP wordt vastgezet; een proxy uit de omgeving wordt niet gebruikt. Elke redirect krijgt dezelfde controle. Een redirect naar een andere host neemt de headers niet mee, en een 307/308 naar een andere host wordt geweigerd zodat de body met geheimen niet meereist. Een publiek IP dat via de router terug het huis in komt, blijft toegestaan.
88
89 ## Vertrouwensgrens
90
91 De systeemgebruiker `bluegit` kan alles lezen wat op de schijf staat, inclusief geheimen (hij heeft `secret.key`). Mensen op de website kunnen dat niet, behalve een beheerder via het JSON-export dat de auth-server verplicht stelt. CI-jobs zien de geheimen die de regel van beschermde branches toelaat. Ze zien de Docker-socket niet.
92
93 Webhooks gaan niet naar een privénetwerk. De classificatie staat in `internal/ssrf`. Een allowlist van hosts, opnieuw proberen en een testknop staan nog op de roadmap.
@@ -0,0 +1,93 @@
1# Architectuur
2
3BlueGit is één proces. Het bedient de website, de git-HTTP-server, de API en (als het aanstaat) de SSH-listener. Een tweede goroutine plant CI-jobs. Metadata staat in SQLite. Git-objecten staan in bare repositories op de datadisk.
4
5```text
6browser ──HTTPS──▶ ingress ──HTTP──▶ bluegit (web + smart HTTP + API)
7git ──HTTPS──▶ ingress ──HTTP──▶ bluegit ──▶ git http-backend ──▶ pre-receive hook
8git ──SSH:22─▶ ingress ──TCP:2222──▶ bluegit ──▶ git-receive-pack ──▶ dezelfde hook
9bluegit ──bearer──▶ auth.timfalken.com
10bluegit ──docker run──▶ jobcontainer
11jobcontainer ──CI_JOB_TOKEN──▶ API van bluegit (release)
12jobcontainer ──SSH-geheim──▶ de host (deploy, gewone SSH)
13```
14
15De ingress staat op een andere machine en doet TLS en SSH-forwarding. BlueGit luistert plain HTTP op `listen`. Clone-URL's komen uit `base_url` en uit `ssh.public_host` / `ssh.public_port`, niet uit de binnenkomende request. `X-Forwarded-For` en `X-Real-IP` gelden alleen als de directe verbinding van een adres in `trusted_proxies` komt. Het voorbeeld staat in [INGRESS.md](INGRESS.md).
16
17## Waarom deze vorm
18
19De mini-PC moet één ding draaien dat je kunt vervangen door een nieuwe binary. Go levert die binary zonder runtime ernaast. SQLite hoeft geen tweede dienst. De git-binary is toch al nodig voor hooks en merges; smart HTTP gaat daarom via `git http-backend` in plaats van een eigen implementatie van het pack-protocol.
20
21Docker is alleen de jobgrens die de eis stelt. BlueGit mount de Docker-socket niet in de job. Een job die de host wil wijzigen, doet dat via SSH met een geheim, net als elke andere repository.
22
23## Schijf
24
25Twee mappen. De state-map is klein en staat vast, standaard `/var/lib/bluegit` (`state_path`, de `StateDirectory` van systemd). Daar staan de database, `secret.key` en de SSH-hostkey, plus het bestand `storage_path` zodra de beheerder een datadisk heeft gekozen. Zonder dat bestand, en zonder een expliciet `storage_path` in de configuratie, is er geen datadisk. De eerste aangemelde gebruiker kiest die in `/setup`. Het pad moet bestaan, beschrijfbaar zijn en minstens 1 GiB vrij hebben. Git en CI antwoorden tot die tijd met een melding.
26
27De datadisk zelf heeft geen standaardpad. Wijzigen mag later in hetzelfde scherm. BlueGit verhuist de bestanden niet; oude repositories blijven op de oude plek staan en worden daar niet meer gezocht.
28
29Onder `ProtectSystem=strict` mag het proces alleen in de state-map schrijven, tot een drop-in `ReadWritePaths` het gekozen pad toevoegt. Die drop-in moet er zijn vóór het opslaan, anders faalt de schrijftest. Voorbeeld: `packaging/storage.conf`.
30
31```text
32/var/lib/bluegit/bluegit.db
33/var/lib/bluegit/secret.key
34/var/lib/bluegit/storage_path
35/var/lib/bluegit/ssh/host_ed25519
36<datadisk>/repos/eigenaar/naam.git
37<datadisk>/artifacts/job-id/…
38<datadisk>/releases/eigenaar/naam/tag/…
39<datadisk>/work/pipeline/job/
40```
41
42Geheimen in de database zijn versleuteld. Sessietokens van de auth-server staan als tekst in SQLite; de bestandsmachtiging van de database is de grens. Versleutelen van die sessies staat op de roadmap.
43
44## Auth
45
46De interface `auth.Provider` heeft `AuthorizeURL`, `Exchange`, `Extend` en `Logout`. `TimFalken` praat met auth.timfalken.com. `Dev` vult dezelfde interface lokaal, zonder wachtwoord, en mag niet aan op het productiedomein.
47
48Na de code-wissel bewaart BlueGit het bearer-token in de sessie. Korter dan zes uur voor het einde wordt `POST /api/session/extend` aangeroepen. Afmelden trekt het token in met `POST /api/logout`.
49
50Git en de API gebruiken een apart toegangstoken (`bg_…`) of, alleen tijdens een job, een job-token (`bgj_…`). Dat zijn geen wachtwoorden: ze worden één keer getoond, als hash bewaard, en zijn in te trekken. Het OAuth-token leeft 24 uur en is een slechte git-credential.
51
52Details en de eisen van de auth-server staan in [AUTH.md](AUTH.md).
53
54## Rechten
55
56`internal/access` is bewust los van HTTP en SQL. `Resolve` kiest de hoogste rol uit persoonlijke eigenaar, groepslid en rechtstreeks lid. `AuthorizeUpdate` keurt een pre-receive-regel goed. De hook is die functie, aangeroepen als `bluegit hook pre-receive`, met de rol en de patronen in de omgeving. Zonder die omgeving weigert de hook, zodat een push om de server heen niet slaagt.
57
58De eerste aangemelde gebruiker is installatiebeheerder. `is_admin` van de auth-server wordt opgeslagen en geeft die vlag niet. Installatiebeheer geeft geen lidmaatschap van andermans repositories of groepen en geen inzage in hun geheimen. Het scherm `/setup` hoort bij die vlag: daar staat alleen het pad van de datadisk.
59
60## Web
61
62De pagina's zijn serverside HTML uit de binary. De router is de standaard `ServeMux` van Go 1.22. Een repository staat op `/{eigenaar}/{naam}`. Git staat op `/{eigenaar}/{naam}.git`. Vaste paden (`/login`, `/groups`, `/settings`, `/api`) winnen van die wildcard.
63
64Formulieren sturen een CSRF-token uit de sessie mee. De API gebruikt een bearer-token en geen CSRF.
65
66## Push naar pipeline
67
68Na een geslaagde smart-HTTP-push of SSH-push vergelijkt BlueGit de refs. Voor elke bijgewerkte branch leest het `blue-ci-cd.yml` op die commit. Ontbreekt het bestand, dan gebeurt er niets. Is het ongeldig, dan komt er een mislukte pipeline met de fout in het log, zodat de push zelf niet blokkeert. Jobs waarvan de `rules` niet kloppen, worden niet aangemaakt.
69
70De runner zet een job op `running`, kloont de commit naar een werkmap, haalt artifacts van eerdere jobs binnen, en start:
71
72```text
73docker run --rm --network <ci.network> -e NAAM …
74 -v werkmap:/workspace --entrypoint sh IMAGE /workspace/.bluegit-job.sh
75```
76
77`-e NAAM` zonder waarde laat Docker de variabele uit de omgeving van BlueGit overnemen. Daardoor blijft een meerregelige SSH-sleutel heel, en staat de waarde niet in de proceslijst. Het netwerk van de container is het gewone Docker-netwerk, niet het hostnetwerk.
78
79`CI_JOB_TOKEN` hoort bij die ene lopende job. De release-API eist dat het token bij deze repository hoort en dat de job nog loopt. Assets moeten al als artifact van een geslaagde job in dezelfde pipeline bestaan.
80
81## Webhooks
82
83Een gebeurtenis gaat naar de webhooks van de repository en, als de repository van een groep is, ook naar die van de groep. Een repository-webhook ziet repositorygeheimen. Een groep-webhook ziet alleen groepgeheimen. Een beschermd geheim gaat mee als de branch van de gebeurtenis beschermd is.
84
85Het branchfilter geldt alleen voor `push`. Andere gebeurtenissen negeren het. Een onbekend geheim of veld in het sjabloon is een fout en er gaat niets uit, zodat er geen webhook vertrekt met een leeg token.
86
87De bestemming wordt bij het verbinden opgelost. Privébereiken (RFC1918, loopback, link-local, CGNAT, ULA en de IPv6-equivalenten, plus multicast en gereserveerde adressen) worden geweigerd, ook als maar één DNS-antwoord daarheen wijst. Het gekozen publieke IP wordt vastgezet; een proxy uit de omgeving wordt niet gebruikt. Elke redirect krijgt dezelfde controle. Een redirect naar een andere host neemt de headers niet mee, en een 307/308 naar een andere host wordt geweigerd zodat de body met geheimen niet meereist. Een publiek IP dat via de router terug het huis in komt, blijft toegestaan.
88
89## Vertrouwensgrens
90
91De systeemgebruiker `bluegit` kan alles lezen wat op de schijf staat, inclusief geheimen (hij heeft `secret.key`). Mensen op de website kunnen dat niet, behalve een beheerder via het JSON-export dat de auth-server verplicht stelt. CI-jobs zien de geheimen die de regel van beschermde branches toelaat. Ze zien de Docker-socket niet.
92
93Webhooks gaan niet naar een privénetwerk. De classificatie staat in `internal/ssrf`. Een allowlist van hosts, opnieuw proberen en een testknop staan nog op de roadmap.
docs/AUTH.md added +52 −0
@@ -0,0 +1,52 @@
1 # Koppeling met auth.timfalken.com
2
3 De auth-server is geen OpenID-provider. `https://auth.timfalken.com/.well-known/openid-configuration` geeft 404. De integratie staat op [https://auth.timfalken.com/help](https://auth.timfalken.com/help) en, machineleesbaar, op [https://auth.timfalken.com/help.json](https://auth.timfalken.com/help.json) (schema 1.7, dienst `account-auth`). Verhalenboek op `projects.timfalken.com` gebruikt dezelfde flow; de README daar noemt dezelfde eindpunten.
4
5 ## Wat een site moet doen
6
7 1. Een beheerder registreert het domein op `/admin`. Het domein is de `client_id`. Voor BlueGit is dat `git.timfalken.com`. Het `client_secret` verschijnt één keer.
8 2. Het callback-pad is alleen het pad, zonder query. Voor BlueGit: `/auth/callback`. De volledige redirect-URI is `https://git.timfalken.com/auth/callback`. Subdomeinen van het geregistreerde domein zijn toegestaan. Een afwijkende poort moet apart geregistreerd worden.
9 3. De browser gaat naar `GET /oauth/authorize` met `client_id`, `redirect_uri`, `response_type=code` en een verplichte `state`.
10 4. De callback controleert `state` en wisselt de code server-side:
11
12 ```http
13 POST /oauth/token
14 Content-Type: application/x-www-form-urlencoded
15 Accept: application/json
16 User-Agent: BlueGitAccountClient/0.1
17
18 grant_type=authorization_code&code=…&redirect_uri=…&client_id=…&client_secret=…
19 ```
20
21 5. Het antwoord bevat `access_token`, `expires_in` (86400) en `user` met `id`, `username` en `avatar_url`. Geen e-mailadres.
22 6. `GET /api/me` met `Authorization: Bearer` vult `is_admin`, `email_verified` en `passkey_only` aan. `is_admin` is beheerder van de auth-server. Dat wordt geen BlueGit-beheerder. Alleen de eerste aangemelde gebruiker van deze installatie is dat, en die vlag geeft geen toegang tot andermans repositories, groepen of geheimen.
23 7. `POST /api/session/extend` schuift de 24 uur op. `POST /api/logout` trekt het token in.
24 8. Elke verbonden site moet een knop hebben waarmee de ingelogde gebruiker meteen zijn gegevens als JSON krijgt. Dat is `Account → Gegevens downloaden` (`GET /settings/export`).
25
26 BlueGit stuurt op elk server-naar-server-verzoek `User-Agent: BlueGitAccountClient/0.1` en `Accept: application/json`.
27
28 ## Wat BlueGit bewaart
29
30 Van het account: het numerieke id, de gebruikersnaam in kleine letters, de avatar-URL, en of die persoon op de auth-server beheerder is. Geen e-mail. Een merge vanaf de website gebruikt daarom `{naam}@users.git.timfalken.com` als afzender. Het bearer-token blijft in de sessietabel tot afmelden of verlopen.
31
32 SSH-sleutels op de auth-server zijn er voor aanmelden dáár (`POST /api/ssh-login/challenge` en `/verify`, namespace `timfalken-account`). Er komt geen API waarmee een verbonden site die sleutels ophaalt. BlueGit houdt eigen sleutels bij voor git-over-SSH. Ze worden geplakt op de accountpagina.
33
34 ## Configuratie
35
36 ```yaml
37 auth:
38 mode: oauth
39 base_url: https://auth.timfalken.com
40 client_id: git.timfalken.com
41 client_secret_file: /etc/bluegit/client_secret
42 redirect_path: /auth/callback
43 user_agent: BlueGitAccountClient/0.1
44 ```
45
46 Een leeg `client_secret` valt terug op het bestand, en dat weer op `BLUEGIT_AUTH_CLIENT_SECRET`.
47
48 `auth.mode: dev` slaat de ronde over en maakt een sessie voor `dev_user`. De configuratie weigert die modus als `base_url` op `git.timfalken.com` staat.
49
50 ## Export
51
52 Het JSON-bestand bevat het account, de namen en voorvoegsels van toegangstokens (niet het token zelf), de publieke SSH-sleutels, en de waarden van geheimen van repositories en groepen waarvan deze gebruiker beheerder is. Dat laatste hoort bij "alle persoonsgegevens", en het is de reden dat alleen die gebruiker de route mag aanroepen.
@@ -0,0 +1,52 @@
1# Koppeling met auth.timfalken.com
2
3De auth-server is geen OpenID-provider. `https://auth.timfalken.com/.well-known/openid-configuration` geeft 404. De integratie staat op [https://auth.timfalken.com/help](https://auth.timfalken.com/help) en, machineleesbaar, op [https://auth.timfalken.com/help.json](https://auth.timfalken.com/help.json) (schema 1.7, dienst `account-auth`). Verhalenboek op `projects.timfalken.com` gebruikt dezelfde flow; de README daar noemt dezelfde eindpunten.
4
5## Wat een site moet doen
6
71. Een beheerder registreert het domein op `/admin`. Het domein is de `client_id`. Voor BlueGit is dat `git.timfalken.com`. Het `client_secret` verschijnt één keer.
82. Het callback-pad is alleen het pad, zonder query. Voor BlueGit: `/auth/callback`. De volledige redirect-URI is `https://git.timfalken.com/auth/callback`. Subdomeinen van het geregistreerde domein zijn toegestaan. Een afwijkende poort moet apart geregistreerd worden.
93. De browser gaat naar `GET /oauth/authorize` met `client_id`, `redirect_uri`, `response_type=code` en een verplichte `state`.
104. De callback controleert `state` en wisselt de code server-side:
11
12```http
13POST /oauth/token
14Content-Type: application/x-www-form-urlencoded
15Accept: application/json
16User-Agent: BlueGitAccountClient/0.1
17
18grant_type=authorization_code&code=…&redirect_uri=…&client_id=…&client_secret=…
19```
20
215. Het antwoord bevat `access_token`, `expires_in` (86400) en `user` met `id`, `username` en `avatar_url`. Geen e-mailadres.
226. `GET /api/me` met `Authorization: Bearer` vult `is_admin`, `email_verified` en `passkey_only` aan. `is_admin` is beheerder van de auth-server. Dat wordt geen BlueGit-beheerder. Alleen de eerste aangemelde gebruiker van deze installatie is dat, en die vlag geeft geen toegang tot andermans repositories, groepen of geheimen.
237. `POST /api/session/extend` schuift de 24 uur op. `POST /api/logout` trekt het token in.
248. Elke verbonden site moet een knop hebben waarmee de ingelogde gebruiker meteen zijn gegevens als JSON krijgt. Dat is `Account → Gegevens downloaden` (`GET /settings/export`).
25
26BlueGit stuurt op elk server-naar-server-verzoek `User-Agent: BlueGitAccountClient/0.1` en `Accept: application/json`.
27
28## Wat BlueGit bewaart
29
30Van het account: het numerieke id, de gebruikersnaam in kleine letters, de avatar-URL, en of die persoon op de auth-server beheerder is. Geen e-mail. Een merge vanaf de website gebruikt daarom `{naam}@users.git.timfalken.com` als afzender. Het bearer-token blijft in de sessietabel tot afmelden of verlopen.
31
32SSH-sleutels op de auth-server zijn er voor aanmelden dáár (`POST /api/ssh-login/challenge` en `/verify`, namespace `timfalken-account`). Er komt geen API waarmee een verbonden site die sleutels ophaalt. BlueGit houdt eigen sleutels bij voor git-over-SSH. Ze worden geplakt op de accountpagina.
33
34## Configuratie
35
36```yaml
37auth:
38 mode: oauth
39 base_url: https://auth.timfalken.com
40 client_id: git.timfalken.com
41 client_secret_file: /etc/bluegit/client_secret
42 redirect_path: /auth/callback
43 user_agent: BlueGitAccountClient/0.1
44```
45
46Een leeg `client_secret` valt terug op het bestand, en dat weer op `BLUEGIT_AUTH_CLIENT_SECRET`.
47
48`auth.mode: dev` slaat de ronde over en maakt een sessie voor `dev_user`. De configuratie weigert die modus als `base_url` op `git.timfalken.com` staat.
49
50## Export
51
52Het JSON-bestand bevat het account, de namen en voorvoegsels van toegangstokens (niet het token zelf), de publieke SSH-sleutels, en de waarden van geheimen van repositories en groepen waarvan deze gebruiker beheerder is. Dat laatste hoort bij "alle persoonsgegevens", en het is de reden dat alleen die gebruiker de route mag aanroepen.
docs/CI.md added +73 −0
@@ -0,0 +1,73 @@
1 # blue-ci-cd.yml
2
3 Het bestand ligt in de root van de commit die de pipeline start. De vorm lijkt op GitLab CI: stages, jobs, needs en rules. Elke job draait in het image dat erbij staat.
4
5 ```yaml
6 stages: [test, build]
7 variables:
8 CGO_ENABLED: "0"
9 image: alpine:3.20
10 jobs:
11 test:
12 stage: test
13 image: golang:1.22
14 script:
15 - go test ./...
16 rules:
17 - if: $CI_COMMIT_BRANCH == "master"
18 - if: $CI_COMMIT_BRANCH =~ /^release\/.*/
19 build:
20 stage: build
21 needs: [test]
22 script:
23 - go build -o bluegit ./cmd/bluegit
24 artifacts:
25 paths: [bluegit]
26 expire_in: 14d
27 allow_failure: false
28 ```
29
30 ## Velden
31
32 | Veld | Betekenis |
33 | --- | --- |
34 | `stages` | Volgorde. Weggelaten: de stages in de volgorde waarin de jobs ze noemen. Een job zonder stage valt in `test`. |
35 | `image` | Standaardimage. Een job zonder eigen image gebruikt die. |
36 | `variables` | Omgevingsvariabelen voor elke job. Een job kan ze overschrijven. |
37 | `jobs.<naam>.script` | Niet-lege lijst. Ze draaien na elkaar in `sh`, met `set -e`. |
38 | `needs` | Jobs die eerst geslaagd of overgeslagen moeten zijn. `needs: []` start meteen. Weggelaten: wacht op alle eerdere stages. |
39 | `rules` | De job draait als minstens één `if` klopt. Zonder rules draait ze altijd. |
40 | `artifacts.paths` | Relatieve paden, geen `..`. Na succes bewaard, en in een volgende job gezet die deze job nodig heeft. |
41 | `artifacts.expire_in` | `30m`, `12h`, `14d`, `2w` of `never`. |
42 | `allow_failure` | Een mislukking houdt de rest niet tegen. |
43
44 Een `if` is één van:
45
46 ```text
47 $NAAM == "waarde"
48 $NAAM != "waarde"
49 $NAAM =~ /reguliere-expressie/
50 ```
51
52 Beschikbaar in rules en in de container: `CI_COMMIT_SHA`, `CI_COMMIT_BRANCH`, `CI_COMMIT_REF`, `CI_PROJECT_PATH`, `CI_PIPELINE_ID`, `CI_JOB_ID`, `CI_JOB_NAME`, `CI_JOB_TOKEN`, `CI_API_URL`.
53
54 ## Geheimen
55
56 Repositorygeheimen komen als omgevingsvariabele mee. Bij een groepsrepository eerst de groep, daarna de repository; dezelfde naam laat de repository winnen. Een geheim dat als beschermd is gemarkeerd, komt alleen mee als de branch op een beschermd patroon past.
57
58 ## Release vanuit een job
59
60 ```shell
61 curl -fsS -X POST "$CI_API_URL/repos/$CI_PROJECT_PATH/releases" \
62 -H "Authorization: Bearer $CI_JOB_TOKEN" \
63 -H "Content-Type: application/json" \
64 -d '{"tag":"v1.2.3","commit":"'"$CI_COMMIT_SHA"'","name":"1.2.3","assets":[{"job":"build","path":"bluegit","name":"bluegit"}]}'
65 ```
66
67 Het commit moet in de repository bestaan. Het asset moet een artifact zijn van een geslaagde job in dezelfde pipeline. Een beheerder kan met een persoonlijk token een release zonder assets maken. Een tag is `A-Za-z0-9._-`, tot 80 tekens, en wordt ook een annotated git-tag.
68
69 ## Wanneer een job start
70
71 `Gate` in `internal/ci` geeft `ready`, `wait` of `skip`. `skip` volgt op een mislukte voorganger zonder `allow_failure`. De runner verwerkt pipelines elke twee seconden, met `ci.concurrency` tegelijk (standaard 1, passend bij de mini-PC).
72
73 Ontbreekt Docker, dan faalt de job met een regel in het log. De time-out is `ci.timeout_seconds` (standaard 1800).
@@ -0,0 +1,73 @@
1# blue-ci-cd.yml
2
3Het bestand ligt in de root van de commit die de pipeline start. De vorm lijkt op GitLab CI: stages, jobs, needs en rules. Elke job draait in het image dat erbij staat.
4
5```yaml
6stages: [test, build]
7variables:
8 CGO_ENABLED: "0"
9image: alpine:3.20
10jobs:
11 test:
12 stage: test
13 image: golang:1.22
14 script:
15 - go test ./...
16 rules:
17 - if: $CI_COMMIT_BRANCH == "master"
18 - if: $CI_COMMIT_BRANCH =~ /^release\/.*/
19 build:
20 stage: build
21 needs: [test]
22 script:
23 - go build -o bluegit ./cmd/bluegit
24 artifacts:
25 paths: [bluegit]
26 expire_in: 14d
27 allow_failure: false
28```
29
30## Velden
31
32| Veld | Betekenis |
33| --- | --- |
34| `stages` | Volgorde. Weggelaten: de stages in de volgorde waarin de jobs ze noemen. Een job zonder stage valt in `test`. |
35| `image` | Standaardimage. Een job zonder eigen image gebruikt die. |
36| `variables` | Omgevingsvariabelen voor elke job. Een job kan ze overschrijven. |
37| `jobs.<naam>.script` | Niet-lege lijst. Ze draaien na elkaar in `sh`, met `set -e`. |
38| `needs` | Jobs die eerst geslaagd of overgeslagen moeten zijn. `needs: []` start meteen. Weggelaten: wacht op alle eerdere stages. |
39| `rules` | De job draait als minstens één `if` klopt. Zonder rules draait ze altijd. |
40| `artifacts.paths` | Relatieve paden, geen `..`. Na succes bewaard, en in een volgende job gezet die deze job nodig heeft. |
41| `artifacts.expire_in` | `30m`, `12h`, `14d`, `2w` of `never`. |
42| `allow_failure` | Een mislukking houdt de rest niet tegen. |
43
44Een `if` is één van:
45
46```text
47$NAAM == "waarde"
48$NAAM != "waarde"
49$NAAM =~ /reguliere-expressie/
50```
51
52Beschikbaar in rules en in de container: `CI_COMMIT_SHA`, `CI_COMMIT_BRANCH`, `CI_COMMIT_REF`, `CI_PROJECT_PATH`, `CI_PIPELINE_ID`, `CI_JOB_ID`, `CI_JOB_NAME`, `CI_JOB_TOKEN`, `CI_API_URL`.
53
54## Geheimen
55
56Repositorygeheimen komen als omgevingsvariabele mee. Bij een groepsrepository eerst de groep, daarna de repository; dezelfde naam laat de repository winnen. Een geheim dat als beschermd is gemarkeerd, komt alleen mee als de branch op een beschermd patroon past.
57
58## Release vanuit een job
59
60```shell
61curl -fsS -X POST "$CI_API_URL/repos/$CI_PROJECT_PATH/releases" \
62 -H "Authorization: Bearer $CI_JOB_TOKEN" \
63 -H "Content-Type: application/json" \
64 -d '{"tag":"v1.2.3","commit":"'"$CI_COMMIT_SHA"'","name":"1.2.3","assets":[{"job":"build","path":"bluegit","name":"bluegit"}]}'
65```
66
67Het commit moet in de repository bestaan. Het asset moet een artifact zijn van een geslaagde job in dezelfde pipeline. Een beheerder kan met een persoonlijk token een release zonder assets maken. Een tag is `A-Za-z0-9._-`, tot 80 tekens, en wordt ook een annotated git-tag.
68
69## Wanneer een job start
70
71`Gate` in `internal/ci` geeft `ready`, `wait` of `skip`. `skip` volgt op een mislukte voorganger zonder `allow_failure`. De runner verwerkt pipelines elke twee seconden, met `ci.concurrency` tegelijk (standaard 1, passend bij de mini-PC).
72
73Ontbreekt Docker, dan faalt de job met een regel in het log. De time-out is `ci.timeout_seconds` (standaard 1800).
docs/INGRESS.md added +64 −0
@@ -0,0 +1,64 @@
1 # Ingress
2
3 BlueGit staat op de mini-PC en spreekt plain HTTP. TLS, certificaten en de publieke SSH-poort horen bij een ingress op een andere machine. Die machine is de enige die vanaf internet bij de mini-PC mag.
4
5 BlueGit bouwt URL's niet uit de binnenkomende `Host`-kop. De externe website is `base_url`. De SSH-clone-URL is `ssh.public_host` en `ssh.public_port`. `listen` en `ssh.listen` zijn alleen de adressen waarop dit proces bindt.
6
7 ## BlueGit
8
9 ```yaml
10 base_url: https://git.timfalken.com
11 listen: 0.0.0.0:8080
12 trusted_proxies:
13 - 10.0.0.2
14 ssh:
15 enabled: true
16 listen: 0.0.0.0:2222
17 public_host: git.timfalken.com
18 public_port: 22
19 ```
20
21 `10.0.0.2` is het adres waarvan de mini-PC de verbinding van de ingress ziet. Een verkeerd adres betekent dat `X-Forwarded-For` genegeerd wordt. Een te ruime lijst, zoals `0.0.0.0/0`, laat elke client zijn adres vervalsen. `behind_proxy: true` uit een oudere configuratie wordt geweigerd.
22
23 In `X-Forwarded-For` telt de rechtse hop die zelf niet op de lijst staat. Een client die `6.6.6.6` vooraan zet, wint daarmee niet van het adres dat de ingress erachter plakt. Ontbreekt die kop, dan geldt `X-Real-IP`, maar alleen vanaf een vertrouwde proxy. `X-Forwarded-Proto` wordt niet gebruikt: de cookie en de OAuth-redirect volgen `base_url`.
24
25 Beperk met de firewall op de mini-PC poort 8080 en 2222 tot de ingress. `listen` op `0.0.0.0` is bereikbaar voor iedereen die tot het netwerk van de mini-PC kan.
26
27 ## Voorbeeld op de ingress
28
29 Caddy doet HTTPS en stuurt door naar de mini-PC. Vervang `10.0.0.5` door het adres van de mini-PC.
30
31 ```caddyfile
32 git.timfalken.com {
33 reverse_proxy 10.0.0.5:8080
34 }
35 ```
36
37 Caddy zet `X-Forwarded-For` en `X-Forwarded-Proto`. Het certificaat komt van Caddy; BlueGit ziet geen TLS.
38
39 SSH is geen HTTP. De ingress stuurt de TCP-stroom door, zodat de hostkey van BlueGit is wat de client controleert. Met de Caddy-module `caddy-l4`:
40
41 ```caddyfile
42 {
43 layer4 {
44 :22 {
45 route {
46 proxy 10.0.0.5:2222
47 }
48 }
49 }
50 }
51 ```
52
53 Zonder die module kan nginx hetzelfde op de stream-laag:
54
55 ```nginx
56 stream {
57 server {
58 listen 22;
59 proxy_pass 10.0.0.5:2222;
60 }
61 }
62 ```
63
64 De clone-URL op de website is dan `ssh://git@git.timfalken.com:22/eigenaar/naam.git`. Op de mini-PC blijft git-SSH op poort 2222 luisteren, naast de SSH van Arch.
@@ -0,0 +1,64 @@
1# Ingress
2
3BlueGit staat op de mini-PC en spreekt plain HTTP. TLS, certificaten en de publieke SSH-poort horen bij een ingress op een andere machine. Die machine is de enige die vanaf internet bij de mini-PC mag.
4
5BlueGit bouwt URL's niet uit de binnenkomende `Host`-kop. De externe website is `base_url`. De SSH-clone-URL is `ssh.public_host` en `ssh.public_port`. `listen` en `ssh.listen` zijn alleen de adressen waarop dit proces bindt.
6
7## BlueGit
8
9```yaml
10base_url: https://git.timfalken.com
11listen: 0.0.0.0:8080
12trusted_proxies:
13 - 10.0.0.2
14ssh:
15 enabled: true
16 listen: 0.0.0.0:2222
17 public_host: git.timfalken.com
18 public_port: 22
19```
20
21`10.0.0.2` is het adres waarvan de mini-PC de verbinding van de ingress ziet. Een verkeerd adres betekent dat `X-Forwarded-For` genegeerd wordt. Een te ruime lijst, zoals `0.0.0.0/0`, laat elke client zijn adres vervalsen. `behind_proxy: true` uit een oudere configuratie wordt geweigerd.
22
23In `X-Forwarded-For` telt de rechtse hop die zelf niet op de lijst staat. Een client die `6.6.6.6` vooraan zet, wint daarmee niet van het adres dat de ingress erachter plakt. Ontbreekt die kop, dan geldt `X-Real-IP`, maar alleen vanaf een vertrouwde proxy. `X-Forwarded-Proto` wordt niet gebruikt: de cookie en de OAuth-redirect volgen `base_url`.
24
25Beperk met de firewall op de mini-PC poort 8080 en 2222 tot de ingress. `listen` op `0.0.0.0` is bereikbaar voor iedereen die tot het netwerk van de mini-PC kan.
26
27## Voorbeeld op de ingress
28
29Caddy doet HTTPS en stuurt door naar de mini-PC. Vervang `10.0.0.5` door het adres van de mini-PC.
30
31```caddyfile
32git.timfalken.com {
33 reverse_proxy 10.0.0.5:8080
34}
35```
36
37Caddy zet `X-Forwarded-For` en `X-Forwarded-Proto`. Het certificaat komt van Caddy; BlueGit ziet geen TLS.
38
39SSH is geen HTTP. De ingress stuurt de TCP-stroom door, zodat de hostkey van BlueGit is wat de client controleert. Met de Caddy-module `caddy-l4`:
40
41```caddyfile
42{
43 layer4 {
44 :22 {
45 route {
46 proxy 10.0.0.5:2222
47 }
48 }
49 }
50}
51```
52
53Zonder die module kan nginx hetzelfde op de stream-laag:
54
55```nginx
56stream {
57 server {
58 listen 22;
59 proxy_pass 10.0.0.5:2222;
60 }
61}
62```
63
64De clone-URL op de website is dan `ssh://git@git.timfalken.com:22/eigenaar/naam.git`. Op de mini-PC blijft git-SSH op poort 2222 luisteren, naast de SSH van Arch.
docs/ROADMAP.md added +28 −0
@@ -0,0 +1,28 @@
1 # Roadmap
2
3 Deze basis is genoeg om repositories te bewaren, te klonen, een pipeline te draaien en BlueGit later zichzelf te laten uitrollen. Hieronder staat wat er nu in zit, en wat bewust nog niet.
4
5 ## In deze basis
6
7 - OAuth naar auth.timfalken.com, met een dev-modus die op het productiedomein geweigerd wordt.
8 - Gebruikers, groepen, repositories, drie rollen, beschermde branches, versleutelde geheimen.
9 - Smart HTTP, een SSH-listener, een webinterface voor bladeren, commits, branches en een eenvoudige merge request.
10 - Parser en runner voor `blue-ci-cd.yml`, artifacts, job-token, releases.
11 - Webhooks met filter, sjabloon en de drie presets.
12 - PKGBUILD, systemd-unit, voorbeeldconfiguratie, `blue-ci-cd.yml` voor BlueGit zelf.
13 - Tests voor rechten, de CI-parser en webhookfilters, plus een test die echt pusht.
14
15 ## Daarna, in deze volgorde
16
17 1. **Productie aanzetten.** Domein registreren, de schijf mounten, `ReadWritePaths` voor dat pad zetten, de ingress uit [INGRESS.md](INGRESS.md) aanzetten, eerste aanmelding en in `/setup` het pad bevestigen, `master` beschermen, deploy-geheimen zetten, één keer met de hand deployen, daarna de pipeline.
18 2. **SSH in de praktijk.** Hostkey publiceren en `known_hosts` vullen. De publieke poort is `ssh.public_port` op de ingress; op de mini-PC blijft `ssh.listen` configureerbaar. Foutmeldingen van de hook gaan al via stderr naar de git-client; de UX van een geweigerde push kan scherper.
19 3. **Merge requests verder.** Opmerkingen, een echte diff in plaats van `git log --oneline`, en een pipeline die groen moet zijn voor het samenvoegen.
20 4. **CI.** Services naast een job (een database voor tests), een cache, live logs in plaats van het log na afloop, en opruimen van verlopen artifacts. Een tweede runner op een andere machine als de mini-PC het niet trekt.
21 5. **Webhooks.** Privénetwerken zijn dicht. Nog te doen: opnieuw proberen, en een knop die een testgebeurtenis stuurt.
22 6. **Git.** LFS als de 4 TB-schijf grote bestanden moet dragen, signed commits, en mirrors. Force-push op een beschermde branch is nu toegestaan voor een beheerder; een aparte schakelaar hoort daarbij.
23 7. **Account.** Uitnodigen voordat iemand ooit is aangemeld werkt al op gebruikersnaam. Een zoekfunctie ontbreekt, omdat de auth-server geen lijst van alle gebruikers aan een site geeft. E-mail naar een gebruiker kan later via `POST /api/email` van de auth-server, zonder het adres te zien.
24 8. **Huiswerk van de server.** Versleutelde sessietokens, back-ups van de state-map én de datadisk, en een limiet op webhookverkeer.
25
26 ## Bewust niet
27
28 Geen issues, wiki, container-registry of code-zoekmachine in deze ronde. Geen lokale wachtwoorden. Geen tweede database. Geen speciaal deploy-pad naast een gewone pipeline.
@@ -0,0 +1,28 @@
1# Roadmap
2
3Deze basis is genoeg om repositories te bewaren, te klonen, een pipeline te draaien en BlueGit later zichzelf te laten uitrollen. Hieronder staat wat er nu in zit, en wat bewust nog niet.
4
5## In deze basis
6
7- OAuth naar auth.timfalken.com, met een dev-modus die op het productiedomein geweigerd wordt.
8- Gebruikers, groepen, repositories, drie rollen, beschermde branches, versleutelde geheimen.
9- Smart HTTP, een SSH-listener, een webinterface voor bladeren, commits, branches en een eenvoudige merge request.
10- Parser en runner voor `blue-ci-cd.yml`, artifacts, job-token, releases.
11- Webhooks met filter, sjabloon en de drie presets.
12- PKGBUILD, systemd-unit, voorbeeldconfiguratie, `blue-ci-cd.yml` voor BlueGit zelf.
13- Tests voor rechten, de CI-parser en webhookfilters, plus een test die echt pusht.
14
15## Daarna, in deze volgorde
16
171. **Productie aanzetten.** Domein registreren, de schijf mounten, `ReadWritePaths` voor dat pad zetten, de ingress uit [INGRESS.md](INGRESS.md) aanzetten, eerste aanmelding en in `/setup` het pad bevestigen, `master` beschermen, deploy-geheimen zetten, één keer met de hand deployen, daarna de pipeline.
182. **SSH in de praktijk.** Hostkey publiceren en `known_hosts` vullen. De publieke poort is `ssh.public_port` op de ingress; op de mini-PC blijft `ssh.listen` configureerbaar. Foutmeldingen van de hook gaan al via stderr naar de git-client; de UX van een geweigerde push kan scherper.
193. **Merge requests verder.** Opmerkingen, een echte diff in plaats van `git log --oneline`, en een pipeline die groen moet zijn voor het samenvoegen.
204. **CI.** Services naast een job (een database voor tests), een cache, live logs in plaats van het log na afloop, en opruimen van verlopen artifacts. Een tweede runner op een andere machine als de mini-PC het niet trekt.
215. **Webhooks.** Privénetwerken zijn dicht. Nog te doen: opnieuw proberen, en een knop die een testgebeurtenis stuurt.
226. **Git.** LFS als de 4 TB-schijf grote bestanden moet dragen, signed commits, en mirrors. Force-push op een beschermde branch is nu toegestaan voor een beheerder; een aparte schakelaar hoort daarbij.
237. **Account.** Uitnodigen voordat iemand ooit is aangemeld werkt al op gebruikersnaam. Een zoekfunctie ontbreekt, omdat de auth-server geen lijst van alle gebruikers aan een site geeft. E-mail naar een gebruiker kan later via `POST /api/email` van de auth-server, zonder het adres te zien.
248. **Huiswerk van de server.** Versleutelde sessietokens, back-ups van de state-map én de datadisk, en een limiet op webhookverkeer.
25
26## Bewust niet
27
28Geen issues, wiki, container-registry of code-zoekmachine in deze ronde. Geen lokale wachtwoorden. Geen tweede database. Geen speciaal deploy-pad naast een gewone pipeline.
docs/VRAGEN.md added +15 −0
@@ -0,0 +1,15 @@
1 # Besluiten
2
3 Tim heeft deze punten beantwoord. Wat hieronder staat is de huidige regel, niet meer een open vraag.
4
5 ## Besloten
6
7 1. **`is_admin` van auth.timfalken.com maakt niemand BlueGit-beheerder.** Alleen de eerste aangemelde gebruiker wordt installatiebeheerder. `is_admin` wordt wel opgeslagen (`users.auth_admin`), maar geeft geen rechten.
8 2. **Er komt geen API voor SSH-sleutels op de auth-server.** BlueGit houdt zijn eigen sleutels, geplakt op de accountpagina. Sleutels op de auth-server blijven alleen voor aanmelden dáár.
9 3. **De standaardbranch is `master`.** Nieuwe repositories en `git.default_branch` gebruiken die naam. De pipeline van BlueGit zelf houdt een regel voor `main` aan, zodat een oude branch nog kan uitrollen.
10 4. **Het afzenderadres van een merge is `{naam}@users.git.timfalken.com`.** De auth-server geeft geen e-mailadres.
11 5. **De installatiebeheerder krijgt geen automatische toegang tot de repositories, groepen en geheimen van anderen.** Die vlag is alleen voor instance-beheer. Het enige scherm dat erbij hoort is `/setup`, voor het pad van de datadisk.
12 6. **Buiten de mini-PC loopt alles via een ingress op een andere machine.** Die doet TLS en stuurt SSH door. BlueGit zelf spreekt plain HTTP op `listen`, vertrouwt `X-Forwarded-For` en `X-Real-IP` alleen van `trusted_proxies`, en zet clone-URL's in elkaar uit `base_url` plus `ssh.public_host` en `ssh.public_port`. `ssh.listen` blijft de poort waarop dit proces bindt en blijft configureerbaar. Het voorbeeld staat in [INGRESS.md](INGRESS.md).
13 7. **Webhooks blokkeren privébestemmingen.** Dat zijn RFC1918, loopback, link-local (inclusief de metadata-adressen `169.254.169.254` en `169.254.170.2`), CGNAT `100.64.0.0/10`, ULA `fc00::/7` (inclusief `fd00:ec2::254`), IPv6-link-local en het oude site-local, plus multicast, unspecified en gereserveerd. Een letterlijk privé-IP in de URL wordt geweigerd. Een naam wordt bij het verbinden opgelost; wijst één van de adressen naar zo'n bereik, dan gaat de webhook niet uit en wordt dat IP vastgezet zodat DNS-rebinding niet alsnog een ander adres kiest. Hetzelfde geldt voor elke redirect. Een naam die via publieke DNS naar een publiek IP wijst mag, ook als de router dat verkeer daarna terug naar het thuisnet stuurt. 6to4 en NAT64 worden beoordeeld op het ingebedde IPv4-adres.
14 8. **De licentie is MIT.**
15 9. **Er is geen standaardpad voor de datadisk.** Database, `secret.key` en de SSH-hostkey staan in de state-map: `state_path`, standaard `/var/lib/bluegit` (systemd `StateDirectory`). De installatiebeheerder kiest het pad van de repositories bij de eerste aanmelding, in het setup-scherm. Het pad moet absoluut zijn, bestaan, beschrijfbaar zijn en minstens 1 GiB vrij hebben; de vrije ruimte wordt getoond. Tot die tijd antwoorden git en CI met een melding en doen ze niets. Het pad later wijzigen mag in hetzelfde scherm, met de waarschuwing dat data niet vanzelf verhuist. Zodra het bestand `storage_path` in de state-map staat, wint dat van `storage_path` in de configuratie.
@@ -0,0 +1,15 @@
1# Besluiten
2
3Tim heeft deze punten beantwoord. Wat hieronder staat is de huidige regel, niet meer een open vraag.
4
5## Besloten
6
71. **`is_admin` van auth.timfalken.com maakt niemand BlueGit-beheerder.** Alleen de eerste aangemelde gebruiker wordt installatiebeheerder. `is_admin` wordt wel opgeslagen (`users.auth_admin`), maar geeft geen rechten.
82. **Er komt geen API voor SSH-sleutels op de auth-server.** BlueGit houdt zijn eigen sleutels, geplakt op de accountpagina. Sleutels op de auth-server blijven alleen voor aanmelden dáár.
93. **De standaardbranch is `master`.** Nieuwe repositories en `git.default_branch` gebruiken die naam. De pipeline van BlueGit zelf houdt een regel voor `main` aan, zodat een oude branch nog kan uitrollen.
104. **Het afzenderadres van een merge is `{naam}@users.git.timfalken.com`.** De auth-server geeft geen e-mailadres.
115. **De installatiebeheerder krijgt geen automatische toegang tot de repositories, groepen en geheimen van anderen.** Die vlag is alleen voor instance-beheer. Het enige scherm dat erbij hoort is `/setup`, voor het pad van de datadisk.
126. **Buiten de mini-PC loopt alles via een ingress op een andere machine.** Die doet TLS en stuurt SSH door. BlueGit zelf spreekt plain HTTP op `listen`, vertrouwt `X-Forwarded-For` en `X-Real-IP` alleen van `trusted_proxies`, en zet clone-URL's in elkaar uit `base_url` plus `ssh.public_host` en `ssh.public_port`. `ssh.listen` blijft de poort waarop dit proces bindt en blijft configureerbaar. Het voorbeeld staat in [INGRESS.md](INGRESS.md).
137. **Webhooks blokkeren privébestemmingen.** Dat zijn RFC1918, loopback, link-local (inclusief de metadata-adressen `169.254.169.254` en `169.254.170.2`), CGNAT `100.64.0.0/10`, ULA `fc00::/7` (inclusief `fd00:ec2::254`), IPv6-link-local en het oude site-local, plus multicast, unspecified en gereserveerd. Een letterlijk privé-IP in de URL wordt geweigerd. Een naam wordt bij het verbinden opgelost; wijst één van de adressen naar zo'n bereik, dan gaat de webhook niet uit en wordt dat IP vastgezet zodat DNS-rebinding niet alsnog een ander adres kiest. Hetzelfde geldt voor elke redirect. Een naam die via publieke DNS naar een publiek IP wijst mag, ook als de router dat verkeer daarna terug naar het thuisnet stuurt. 6to4 en NAT64 worden beoordeeld op het ingebedde IPv4-adres.
148. **De licentie is MIT.**
159. **Er is geen standaardpad voor de datadisk.** Database, `secret.key` en de SSH-hostkey staan in de state-map: `state_path`, standaard `/var/lib/bluegit` (systemd `StateDirectory`). De installatiebeheerder kiest het pad van de repositories bij de eerste aanmelding, in het setup-scherm. Het pad moet absoluut zijn, bestaan, beschrijfbaar zijn en minstens 1 GiB vrij hebben; de vrije ruimte wordt getoond. Tot die tijd antwoorden git en CI met een melding en doen ze niets. Het pad later wijzigen mag in hetzelfde scherm, met de waarschuwing dat data niet vanzelf verhuist. Zodra het bestand `storage_path` in de state-map staat, wint dat van `storage_path` in de configuratie.
go.mod added +21 −0
@@ -0,0 +1,21 @@
1 module gitlab.com/Timfa/bluegit
2
3 go 1.22
4
5 require (
6 golang.org/x/crypto v0.31.0
7 gopkg.in/yaml.v3 v3.0.1
8 modernc.org/sqlite v1.34.5
9 )
10
11 require (
12 github.com/dustin/go-humanize v1.0.1 // indirect
13 github.com/google/uuid v1.6.0 // indirect
14 github.com/mattn/go-isatty v0.0.20 // indirect
15 github.com/ncruces/go-strftime v0.1.9 // indirect
16 github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec // indirect
17 golang.org/x/sys v0.28.0 // indirect
18 modernc.org/libc v1.55.3 // indirect
19 modernc.org/mathutil v1.6.0 // indirect
20 modernc.org/memory v1.8.0 // indirect
21 )
@@ -0,0 +1,21 @@
1module gitlab.com/Timfa/bluegit
2
3go 1.22
4
5require (
6 golang.org/x/crypto v0.31.0
7 gopkg.in/yaml.v3 v3.0.1
8 modernc.org/sqlite v1.34.5
9)
10
11require (
12 github.com/dustin/go-humanize v1.0.1 // indirect
13 github.com/google/uuid v1.6.0 // indirect
14 github.com/mattn/go-isatty v0.0.20 // indirect
15 github.com/ncruces/go-strftime v0.1.9 // indirect
16 github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec // indirect
17 golang.org/x/sys v0.28.0 // indirect
18 modernc.org/libc v1.55.3 // indirect
19 modernc.org/mathutil v1.6.0 // indirect
20 modernc.org/memory v1.8.0 // indirect
21)
go.sum added +51 −0
@@ -0,0 +1,51 @@
1 github.com/dustin/go-humanize v1.0.1 h1:GzkhY7T5VNhEkwH0PVJgjz+fX1rhBrR7pRT3mDkpeCY=
2 github.com/dustin/go-humanize v1.0.1/go.mod h1:Mu1zIs6XwVuF/gI1OepvI0qD18qycQx+mFykh5fBlto=
3 github.com/google/pprof v0.0.0-20240409012703-83162a5b38cd h1:gbpYu9NMq8jhDVbvlGkMFWCjLFlqqEZjEmObmhUy6Vo=
4 github.com/google/pprof v0.0.0-20240409012703-83162a5b38cd/go.mod h1:kf6iHlnVGwgKolg33glAes7Yg/8iWP8ukqeldJSO7jw=
5 github.com/google/uuid v1.6.0 h1:NIvaJDMOsjHA8n1jAhLSgzrAzy1Hgr+hNrb57e+94F0=
6 github.com/google/uuid v1.6.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo=
7 github.com/mattn/go-isatty v0.0.20 h1:xfD0iDuEKnDkl03q4limB+vH+GxLEtL/jb4xVJSWWEY=
8 github.com/mattn/go-isatty v0.0.20/go.mod h1:W+V8PltTTMOvKvAeJH7IuucS94S2C6jfK/D7dTCTo3Y=
9 github.com/ncruces/go-strftime v0.1.9 h1:bY0MQC28UADQmHmaF5dgpLmImcShSi2kHU9XLdhx/f4=
10 github.com/ncruces/go-strftime v0.1.9/go.mod h1:Fwc5htZGVVkseilnfgOVb9mKy6w1naJmn9CehxcKcls=
11 github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec h1:W09IVJc94icq4NjY3clb7Lk8O1qJ8BdBEF8z0ibU0rE=
12 github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec/go.mod h1:qqbHyh8v60DhA7CoWK5oRCqLrMHRGoxYCSS9EjAz6Eo=
13 golang.org/x/crypto v0.31.0 h1:ihbySMvVjLAeSH1IbfcRTkD/iNscyz8rGzjF/E5hV6U=
14 golang.org/x/crypto v0.31.0/go.mod h1:kDsLvtWBEx7MV9tJOj9bnXsPbxwJQ6csT/x4KIN4Ssk=
15 golang.org/x/mod v0.16.0 h1:QX4fJ0Rr5cPQCF7O9lh9Se4pmwfwskqZfq5moyldzic=
16 golang.org/x/mod v0.16.0/go.mod h1:hTbmBsO62+eylJbnUtE2MGJUyE7QWk4xUqPFrRgJ+7c=
17 golang.org/x/sys v0.6.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
18 golang.org/x/sys v0.28.0 h1:Fksou7UEQUWlKvIdsqzJmUmCX3cZuD2+P3XyyzwMhlA=
19 golang.org/x/sys v0.28.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
20 golang.org/x/term v0.27.0 h1:WP60Sv1nlK1T6SupCHbXzSaN0b9wUmsPoRS9b61A23Q=
21 golang.org/x/term v0.27.0/go.mod h1:iMsnZpn0cago0GOrHO2+Y7u7JPn5AylBrcoWkElMTSM=
22 golang.org/x/tools v0.19.0 h1:tfGCXNR1OsFG+sVdLAitlpjAvD/I6dHDKnYrpEZUHkw=
23 golang.org/x/tools v0.19.0/go.mod h1:qoJWxmGSIBmAeriMx19ogtrEPrGtDbPK634QFIcLAhc=
24 gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405 h1:yhCVgyC4o1eVCa2tZl7eS0r+SDo693bJlVdllGtEeKM=
25 gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
26 gopkg.in/yaml.v3 v3.0.1 h1:fxVm/GzAzEWqLHuvctI91KS9hhNmmWOoWu0XTYJS7CA=
27 gopkg.in/yaml.v3 v3.0.1/go.mod h1:K4uyk7z7BCEPqu6E+C64Yfv1cQ7kz7rIZviUmN+EgEM=
28 modernc.org/cc/v4 v4.21.4 h1:3Be/Rdo1fpr8GrQ7IVw9OHtplU4gWbb+wNgeoBMmGLQ=
29 modernc.org/cc/v4 v4.21.4/go.mod h1:HM7VJTZbUCR3rV8EYBi9wxnJ0ZBRiGE5OeGXNA0IsLQ=
30 modernc.org/ccgo/v4 v4.19.2 h1:lwQZgvboKD0jBwdaeVCTouxhxAyN6iawF3STraAal8Y=
31 modernc.org/ccgo/v4 v4.19.2/go.mod h1:ysS3mxiMV38XGRTTcgo0DQTeTmAO4oCmJl1nX9VFI3s=
32 modernc.org/fileutil v1.3.0 h1:gQ5SIzK3H9kdfai/5x41oQiKValumqNTDXMvKo62HvE=
33 modernc.org/fileutil v1.3.0/go.mod h1:XatxS8fZi3pS8/hKG2GH/ArUogfxjpEKs3Ku3aK4JyQ=
34 modernc.org/gc/v2 v2.4.1 h1:9cNzOqPyMJBvrUipmynX0ZohMhcxPtMccYgGOJdOiBw=
35 modernc.org/gc/v2 v2.4.1/go.mod h1:wzN5dK1AzVGoH6XOzc3YZ+ey/jPgYHLuVckd62P0GYU=
36 modernc.org/libc v1.55.3 h1:AzcW1mhlPNrRtjS5sS+eW2ISCgSOLLNyFzRh/V3Qj/U=
37 modernc.org/libc v1.55.3/go.mod h1:qFXepLhz+JjFThQ4kzwzOjA/y/artDeg+pcYnY+Q83w=
38 modernc.org/mathutil v1.6.0 h1:fRe9+AmYlaej+64JsEEhoWuAYBkOtQiMEU7n/XgfYi4=
39 modernc.org/mathutil v1.6.0/go.mod h1:Ui5Q9q1TR2gFm0AQRqQUaBWFLAhQpCwNcuhBOSedWPo=
40 modernc.org/memory v1.8.0 h1:IqGTL6eFMaDZZhEWwcREgeMXYwmW83LYW8cROZYkg+E=
41 modernc.org/memory v1.8.0/go.mod h1:XPZ936zp5OMKGWPqbD3JShgd/ZoQ7899TUuQqxY+peU=
42 modernc.org/opt v0.1.3 h1:3XOZf2yznlhC+ibLltsDGzABUGVx8J6pnFMS3E4dcq4=
43 modernc.org/opt v0.1.3/go.mod h1:WdSiB5evDcignE70guQKxYUl14mgWtbClRi5wmkkTX0=
44 modernc.org/sortutil v1.2.0 h1:jQiD3PfS2REGJNzNCMMaLSp/wdMNieTbKX920Cqdgqc=
45 modernc.org/sortutil v1.2.0/go.mod h1:TKU2s7kJMf1AE84OoiGppNHJwvB753OYfNl2WRb++Ss=
46 modernc.org/sqlite v1.34.5 h1:Bb6SR13/fjp15jt70CL4f18JIN7p7dnMExd+UFnF15g=
47 modernc.org/sqlite v1.34.5/go.mod h1:YLuNmX9NKs8wRNK2ko1LW1NGYcc9FkBO69JOt1AR9JE=
48 modernc.org/strutil v1.2.0 h1:agBi9dp1I+eOnxXeiZawM8F4LawKv4NzGWSaLfyeNZA=
49 modernc.org/strutil v1.2.0/go.mod h1:/mdcBmfOibveCTBxUl5B5l6W+TTH1FXPLHZE6bTosX0=
50 modernc.org/token v1.1.0 h1:Xl7Ap9dKaEs5kLoOQeQmPWevfnk/DM5qcLcYlA8ys6Y=
51 modernc.org/token v1.1.0/go.mod h1:UGzOrNV1mAFSEB63lOFHIpNRUVMvYTc6yu1SMY/XTDM=
@@ -0,0 +1,51 @@
1github.com/dustin/go-humanize v1.0.1 h1:GzkhY7T5VNhEkwH0PVJgjz+fX1rhBrR7pRT3mDkpeCY=
2github.com/dustin/go-humanize v1.0.1/go.mod h1:Mu1zIs6XwVuF/gI1OepvI0qD18qycQx+mFykh5fBlto=
3github.com/google/pprof v0.0.0-20240409012703-83162a5b38cd h1:gbpYu9NMq8jhDVbvlGkMFWCjLFlqqEZjEmObmhUy6Vo=
4github.com/google/pprof v0.0.0-20240409012703-83162a5b38cd/go.mod h1:kf6iHlnVGwgKolg33glAes7Yg/8iWP8ukqeldJSO7jw=
5github.com/google/uuid v1.6.0 h1:NIvaJDMOsjHA8n1jAhLSgzrAzy1Hgr+hNrb57e+94F0=
6github.com/google/uuid v1.6.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo=
7github.com/mattn/go-isatty v0.0.20 h1:xfD0iDuEKnDkl03q4limB+vH+GxLEtL/jb4xVJSWWEY=
8github.com/mattn/go-isatty v0.0.20/go.mod h1:W+V8PltTTMOvKvAeJH7IuucS94S2C6jfK/D7dTCTo3Y=
9github.com/ncruces/go-strftime v0.1.9 h1:bY0MQC28UADQmHmaF5dgpLmImcShSi2kHU9XLdhx/f4=
10github.com/ncruces/go-strftime v0.1.9/go.mod h1:Fwc5htZGVVkseilnfgOVb9mKy6w1naJmn9CehxcKcls=
11github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec h1:W09IVJc94icq4NjY3clb7Lk8O1qJ8BdBEF8z0ibU0rE=
12github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec/go.mod h1:qqbHyh8v60DhA7CoWK5oRCqLrMHRGoxYCSS9EjAz6Eo=
13golang.org/x/crypto v0.31.0 h1:ihbySMvVjLAeSH1IbfcRTkD/iNscyz8rGzjF/E5hV6U=
14golang.org/x/crypto v0.31.0/go.mod h1:kDsLvtWBEx7MV9tJOj9bnXsPbxwJQ6csT/x4KIN4Ssk=
15golang.org/x/mod v0.16.0 h1:QX4fJ0Rr5cPQCF7O9lh9Se4pmwfwskqZfq5moyldzic=
16golang.org/x/mod v0.16.0/go.mod h1:hTbmBsO62+eylJbnUtE2MGJUyE7QWk4xUqPFrRgJ+7c=
17golang.org/x/sys v0.6.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
18golang.org/x/sys v0.28.0 h1:Fksou7UEQUWlKvIdsqzJmUmCX3cZuD2+P3XyyzwMhlA=
19golang.org/x/sys v0.28.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
20golang.org/x/term v0.27.0 h1:WP60Sv1nlK1T6SupCHbXzSaN0b9wUmsPoRS9b61A23Q=
21golang.org/x/term v0.27.0/go.mod h1:iMsnZpn0cago0GOrHO2+Y7u7JPn5AylBrcoWkElMTSM=
22golang.org/x/tools v0.19.0 h1:tfGCXNR1OsFG+sVdLAitlpjAvD/I6dHDKnYrpEZUHkw=
23golang.org/x/tools v0.19.0/go.mod h1:qoJWxmGSIBmAeriMx19ogtrEPrGtDbPK634QFIcLAhc=
24gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405 h1:yhCVgyC4o1eVCa2tZl7eS0r+SDo693bJlVdllGtEeKM=
25gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
26gopkg.in/yaml.v3 v3.0.1 h1:fxVm/GzAzEWqLHuvctI91KS9hhNmmWOoWu0XTYJS7CA=
27gopkg.in/yaml.v3 v3.0.1/go.mod h1:K4uyk7z7BCEPqu6E+C64Yfv1cQ7kz7rIZviUmN+EgEM=
28modernc.org/cc/v4 v4.21.4 h1:3Be/Rdo1fpr8GrQ7IVw9OHtplU4gWbb+wNgeoBMmGLQ=
29modernc.org/cc/v4 v4.21.4/go.mod h1:HM7VJTZbUCR3rV8EYBi9wxnJ0ZBRiGE5OeGXNA0IsLQ=
30modernc.org/ccgo/v4 v4.19.2 h1:lwQZgvboKD0jBwdaeVCTouxhxAyN6iawF3STraAal8Y=
31modernc.org/ccgo/v4 v4.19.2/go.mod h1:ysS3mxiMV38XGRTTcgo0DQTeTmAO4oCmJl1nX9VFI3s=
32modernc.org/fileutil v1.3.0 h1:gQ5SIzK3H9kdfai/5x41oQiKValumqNTDXMvKo62HvE=
33modernc.org/fileutil v1.3.0/go.mod h1:XatxS8fZi3pS8/hKG2GH/ArUogfxjpEKs3Ku3aK4JyQ=
34modernc.org/gc/v2 v2.4.1 h1:9cNzOqPyMJBvrUipmynX0ZohMhcxPtMccYgGOJdOiBw=
35modernc.org/gc/v2 v2.4.1/go.mod h1:wzN5dK1AzVGoH6XOzc3YZ+ey/jPgYHLuVckd62P0GYU=
36modernc.org/libc v1.55.3 h1:AzcW1mhlPNrRtjS5sS+eW2ISCgSOLLNyFzRh/V3Qj/U=
37modernc.org/libc v1.55.3/go.mod h1:qFXepLhz+JjFThQ4kzwzOjA/y/artDeg+pcYnY+Q83w=
38modernc.org/mathutil v1.6.0 h1:fRe9+AmYlaej+64JsEEhoWuAYBkOtQiMEU7n/XgfYi4=
39modernc.org/mathutil v1.6.0/go.mod h1:Ui5Q9q1TR2gFm0AQRqQUaBWFLAhQpCwNcuhBOSedWPo=
40modernc.org/memory v1.8.0 h1:IqGTL6eFMaDZZhEWwcREgeMXYwmW83LYW8cROZYkg+E=
41modernc.org/memory v1.8.0/go.mod h1:XPZ936zp5OMKGWPqbD3JShgd/ZoQ7899TUuQqxY+peU=
42modernc.org/opt v0.1.3 h1:3XOZf2yznlhC+ibLltsDGzABUGVx8J6pnFMS3E4dcq4=
43modernc.org/opt v0.1.3/go.mod h1:WdSiB5evDcignE70guQKxYUl14mgWtbClRi5wmkkTX0=
44modernc.org/sortutil v1.2.0 h1:jQiD3PfS2REGJNzNCMMaLSp/wdMNieTbKX920Cqdgqc=
45modernc.org/sortutil v1.2.0/go.mod h1:TKU2s7kJMf1AE84OoiGppNHJwvB753OYfNl2WRb++Ss=
46modernc.org/sqlite v1.34.5 h1:Bb6SR13/fjp15jt70CL4f18JIN7p7dnMExd+UFnF15g=
47modernc.org/sqlite v1.34.5/go.mod h1:YLuNmX9NKs8wRNK2ko1LW1NGYcc9FkBO69JOt1AR9JE=
48modernc.org/strutil v1.2.0 h1:agBi9dp1I+eOnxXeiZawM8F4LawKv4NzGWSaLfyeNZA=
49modernc.org/strutil v1.2.0/go.mod h1:/mdcBmfOibveCTBxUl5B5l6W+TTH1FXPLHZE6bTosX0=
50modernc.org/token v1.1.0 h1:Xl7Ap9dKaEs5kLoOQeQmPWevfnk/DM5qcLcYlA8ys6Y=
51modernc.org/token v1.1.0/go.mod h1:UGzOrNV1mAFSEB63lOFHIpNRUVMvYTc6yu1SMY/XTDM=
internal/access/access.go added +217 −0
@@ -0,0 +1,217 @@
1 // Package access bevat de rolregels van BlueGit.
2 // Een repository hoort bij een gebruiker of een groep. Leden hebben
3 // Readonly, Developer of Maintainer. De effectieve rol is de hoogste
4 // van groepslidmaatschap, rechtstreeks repolidmaatschap en eigenaarschap.
5 // Installatiebeheer is hier geen rol: dat geeft geen toegang tot
6 // repositories, groepen of geheimen van anderen.
7 package access
8
9 import (
10 "fmt"
11 "path"
12 "strings"
13 )
14
15 // Role is een toegangsrol op een repository of groep.
16 type Role string
17
18 const (
19 RoleNone Role = ""
20 RoleReadonly Role = "readonly"
21 RoleDeveloper Role = "developer"
22 RoleMaintainer Role = "maintainer"
23 )
24
25 // ParseRole herkent de drie rollen. Leeg is geen rol.
26 func ParseRole(s string) (Role, error) {
27 switch Role(strings.ToLower(strings.TrimSpace(s))) {
28 case RoleReadonly:
29 return RoleReadonly, nil
30 case RoleDeveloper:
31 return RoleDeveloper, nil
32 case RoleMaintainer:
33 return RoleMaintainer, nil
34 case RoleNone:
35 return RoleNone, fmt.Errorf("rol ontbreekt")
36 default:
37 return RoleNone, fmt.Errorf("onbekende rol %q", s)
38 }
39 }
40
41 // Label is de Nederlandse naam in de interface.
42 func (r Role) Label() string {
43 switch r {
44 case RoleReadonly:
45 return "Alleen lezen"
46 case RoleDeveloper:
47 return "Ontwikkelaar"
48 case RoleMaintainer:
49 return "Beheerder"
50 default:
51 return "Geen"
52 }
53 }
54
55 // Rank geeft een volgorde. Hoger mag meer.
56 func (r Role) Rank() int {
57 switch r {
58 case RoleReadonly:
59 return 1
60 case RoleDeveloper:
61 return 2
62 case RoleMaintainer:
63 return 3
64 default:
65 return 0
66 }
67 }
68
69 // Max geeft de hoogste van twee rollen.
70 func Max(a, b Role) Role {
71 if a.Rank() >= b.Rank() {
72 return a
73 }
74 return b
75 }
76
77 // AtLeast meldt of de rol minstens other is.
78 func (r Role) AtLeast(other Role) bool {
79 return r.Rank() >= other.Rank()
80 }
81
82 // CanRead geldt voor elke echte rol.
83 func (r Role) CanRead() bool { return r.AtLeast(RoleReadonly) }
84
85 // CanWriteCode geldt voor ontwikkelaar en beheerder.
86 // Protected branches en secrets vallen hier buiten.
87 func (r Role) CanWriteCode() bool { return r.AtLeast(RoleDeveloper) }
88
89 // CanManageSecrets geldt alleen voor een beheerder.
90 func (r Role) CanManageSecrets() bool { return r.AtLeast(RoleMaintainer) }
91
92 // CanManageSettings dekt leden, webhooks, beschermde branches en verwijderen.
93 func (r Role) CanManageSettings() bool { return r.AtLeast(RoleMaintainer) }
94
95 // CanPushBranch meldt of deze rol naar een branch mag schrijven.
96 // protected is waar als de branch op een beschermd patroon past.
97 func (r Role) CanPushBranch(protected bool) bool {
98 if protected {
99 return r.CanManageSettings()
100 }
101 return r.CanWriteCode()
102 }
103
104 // CanMerge meldt of deze rol een merge request naar target mag samenvoegen.
105 func (r Role) CanMerge(targetProtected bool) bool {
106 return r.CanPushBranch(targetProtected)
107 }
108
109 // Input is alles wat meespeelt bij de effectieve rol op één repository.
110 // Installatiebeheer zit hier bewust niet in.
111 type Input struct {
112 // UserOwner is waar als de repository van deze gebruiker zelf is.
113 UserOwner bool
114 // GroupRole is de rol in de groep die de repository bezit. Leeg als
115 // de repository niet van een groep is of de gebruiker geen lid is.
116 GroupRole Role
117 // RepoRole is een rechtstreeks lidmaatschap op de repository.
118 RepoRole Role
119 }
120
121 // Resolve kiest de effectieve rol.
122 // De persoonlijke eigenaar is beheerder. Anders geldt de hoogste van
123 // groepsrol en repositoryrol.
124 func Resolve(in Input) Role {
125 if in.UserOwner {
126 return RoleMaintainer
127 }
128 return Max(in.GroupRole, in.RepoRole)
129 }
130
131 // BranchProtected meldt of branch op een van de patronen past.
132 // Een patroon is exact, of een glob waarin * één padsegment is
133 // (path.Match). "release/*" past dus op "release/1.2" en niet op
134 // "release/1.2/rc".
135 func BranchProtected(patterns []string, branch string) bool {
136 for _, p := range patterns {
137 p = strings.TrimSpace(p)
138 if p == "" {
139 continue
140 }
141 if p == branch {
142 return true
143 }
144 ok, err := path.Match(p, branch)
145 if err == nil && ok {
146 return true
147 }
148 }
149 return false
150 }
151
152 // RefUpdate is één regel uit een pre-receive-hook.
153 type RefUpdate struct {
154 Old string
155 New string
156 Ref string
157 }
158
159 // AuthorizeUpdate keurt één ref-update goed of af.
160 // Alleen refs/heads/* kan beschermd zijn. Overige refs (tags, notes)
161 // mag een ontwikkelaar schrijven. Alleen-lezen mag niets schrijven.
162 func AuthorizeUpdate(role Role, patterns []string, u RefUpdate) error {
163 if !role.CanWriteCode() {
164 return fmt.Errorf("geen schrijfrechten op %s", u.Ref)
165 }
166 const heads = "refs/heads/"
167 if !strings.HasPrefix(u.Ref, heads) {
168 return nil
169 }
170 branch := strings.TrimPrefix(u.Ref, heads)
171 if branch == "" || strings.Contains(branch, "..") {
172 return fmt.Errorf("ongeldige branch %q", branch)
173 }
174 if BranchProtected(patterns, branch) && !role.CanPushBranch(true) {
175 return fmt.Errorf("branch %s is beschermd; alleen een beheerder mag die wijzigen", branch)
176 }
177 return nil
178 }
179
180 // AuthorizeUpdates keurt een hele push goed. De eerste fout stopt.
181 func AuthorizeUpdates(role Role, patterns []string, updates []RefUpdate) error {
182 if len(updates) == 0 {
183 return fmt.Errorf("lege push")
184 }
185 for _, u := range updates {
186 if err := AuthorizeUpdate(role, patterns, u); err != nil {
187 return err
188 }
189 }
190 return nil
191 }
192
193 // InjectSecret meldt of een CI-job dit geheim als omgevingsvariabele krijgt.
194 // Een beschermd geheim gaat alleen mee als de pipeline op een beschermde
195 // branch draait. Onbeschermde geheimen gaan met elke job mee.
196 // Dit is onafhankelijk van de UI: een ontwikkelaar leest geheimen nooit
197 // terug, ook al belanden ze in een job die zijn pipeline startte.
198 func InjectSecret(secretProtected, refProtected bool) bool {
199 if secretProtected {
200 return refProtected
201 }
202 return true
203 }
204
205 // ValidSecretName eist een omgevingsvariabelenaam.
206 func ValidSecretName(name string) error {
207 if name == "" || len(name) > 80 {
208 return fmt.Errorf("geheimnaam moet 1 tot 80 tekens zijn")
209 }
210 for i, c := range name {
211 ok := c == '_' || (c >= 'A' && c <= 'Z') || (i > 0 && c >= '0' && c <= '9')
212 if !ok {
213 return fmt.Errorf("geheimnaam %q moet [A-Z][A-Z0-9_]* zijn", name)
214 }
215 }
216 return nil
217 }
@@ -0,0 +1,217 @@
1// Package access bevat de rolregels van BlueGit.
2// Een repository hoort bij een gebruiker of een groep. Leden hebben
3// Readonly, Developer of Maintainer. De effectieve rol is de hoogste
4// van groepslidmaatschap, rechtstreeks repolidmaatschap en eigenaarschap.
5// Installatiebeheer is hier geen rol: dat geeft geen toegang tot
6// repositories, groepen of geheimen van anderen.
7package access
8
9import (
10 "fmt"
11 "path"
12 "strings"
13)
14
15// Role is een toegangsrol op een repository of groep.
16type Role string
17
18const (
19 RoleNone Role = ""
20 RoleReadonly Role = "readonly"
21 RoleDeveloper Role = "developer"
22 RoleMaintainer Role = "maintainer"
23)
24
25// ParseRole herkent de drie rollen. Leeg is geen rol.
26func ParseRole(s string) (Role, error) {
27 switch Role(strings.ToLower(strings.TrimSpace(s))) {
28 case RoleReadonly:
29 return RoleReadonly, nil
30 case RoleDeveloper:
31 return RoleDeveloper, nil
32 case RoleMaintainer:
33 return RoleMaintainer, nil
34 case RoleNone:
35 return RoleNone, fmt.Errorf("rol ontbreekt")
36 default:
37 return RoleNone, fmt.Errorf("onbekende rol %q", s)
38 }
39}
40
41// Label is de Nederlandse naam in de interface.
42func (r Role) Label() string {
43 switch r {
44 case RoleReadonly:
45 return "Alleen lezen"
46 case RoleDeveloper:
47 return "Ontwikkelaar"
48 case RoleMaintainer:
49 return "Beheerder"
50 default:
51 return "Geen"
52 }
53}
54
55// Rank geeft een volgorde. Hoger mag meer.
56func (r Role) Rank() int {
57 switch r {
58 case RoleReadonly:
59 return 1
60 case RoleDeveloper:
61 return 2
62 case RoleMaintainer:
63 return 3
64 default:
65 return 0
66 }
67}
68
69// Max geeft de hoogste van twee rollen.
70func Max(a, b Role) Role {
71 if a.Rank() >= b.Rank() {
72 return a
73 }
74 return b
75}
76
77// AtLeast meldt of de rol minstens other is.
78func (r Role) AtLeast(other Role) bool {
79 return r.Rank() >= other.Rank()
80}
81
82// CanRead geldt voor elke echte rol.
83func (r Role) CanRead() bool { return r.AtLeast(RoleReadonly) }
84
85// CanWriteCode geldt voor ontwikkelaar en beheerder.
86// Protected branches en secrets vallen hier buiten.
87func (r Role) CanWriteCode() bool { return r.AtLeast(RoleDeveloper) }
88
89// CanManageSecrets geldt alleen voor een beheerder.
90func (r Role) CanManageSecrets() bool { return r.AtLeast(RoleMaintainer) }
91
92// CanManageSettings dekt leden, webhooks, beschermde branches en verwijderen.
93func (r Role) CanManageSettings() bool { return r.AtLeast(RoleMaintainer) }
94
95// CanPushBranch meldt of deze rol naar een branch mag schrijven.
96// protected is waar als de branch op een beschermd patroon past.
97func (r Role) CanPushBranch(protected bool) bool {
98 if protected {
99 return r.CanManageSettings()
100 }
101 return r.CanWriteCode()
102}
103
104// CanMerge meldt of deze rol een merge request naar target mag samenvoegen.
105func (r Role) CanMerge(targetProtected bool) bool {
106 return r.CanPushBranch(targetProtected)
107}
108
109// Input is alles wat meespeelt bij de effectieve rol op één repository.
110// Installatiebeheer zit hier bewust niet in.
111type Input struct {
112 // UserOwner is waar als de repository van deze gebruiker zelf is.
113 UserOwner bool
114 // GroupRole is de rol in de groep die de repository bezit. Leeg als
115 // de repository niet van een groep is of de gebruiker geen lid is.
116 GroupRole Role
117 // RepoRole is een rechtstreeks lidmaatschap op de repository.
118 RepoRole Role
119}
120
121// Resolve kiest de effectieve rol.
122// De persoonlijke eigenaar is beheerder. Anders geldt de hoogste van
123// groepsrol en repositoryrol.
124func Resolve(in Input) Role {
125 if in.UserOwner {
126 return RoleMaintainer
127 }
128 return Max(in.GroupRole, in.RepoRole)
129}
130
131// BranchProtected meldt of branch op een van de patronen past.
132// Een patroon is exact, of een glob waarin * één padsegment is
133// (path.Match). "release/*" past dus op "release/1.2" en niet op
134// "release/1.2/rc".
135func BranchProtected(patterns []string, branch string) bool {
136 for _, p := range patterns {
137 p = strings.TrimSpace(p)
138 if p == "" {
139 continue
140 }
141 if p == branch {
142 return true
143 }
144 ok, err := path.Match(p, branch)
145 if err == nil && ok {
146 return true
147 }
148 }
149 return false
150}
151
152// RefUpdate is één regel uit een pre-receive-hook.
153type RefUpdate struct {
154 Old string
155 New string
156 Ref string
157}
158
159// AuthorizeUpdate keurt één ref-update goed of af.
160// Alleen refs/heads/* kan beschermd zijn. Overige refs (tags, notes)
161// mag een ontwikkelaar schrijven. Alleen-lezen mag niets schrijven.
162func AuthorizeUpdate(role Role, patterns []string, u RefUpdate) error {
163 if !role.CanWriteCode() {
164 return fmt.Errorf("geen schrijfrechten op %s", u.Ref)
165 }
166 const heads = "refs/heads/"
167 if !strings.HasPrefix(u.Ref, heads) {
168 return nil
169 }
170 branch := strings.TrimPrefix(u.Ref, heads)
171 if branch == "" || strings.Contains(branch, "..") {
172 return fmt.Errorf("ongeldige branch %q", branch)
173 }
174 if BranchProtected(patterns, branch) && !role.CanPushBranch(true) {
175 return fmt.Errorf("branch %s is beschermd; alleen een beheerder mag die wijzigen", branch)
176 }
177 return nil
178}
179
180// AuthorizeUpdates keurt een hele push goed. De eerste fout stopt.
181func AuthorizeUpdates(role Role, patterns []string, updates []RefUpdate) error {
182 if len(updates) == 0 {
183 return fmt.Errorf("lege push")
184 }
185 for _, u := range updates {
186 if err := AuthorizeUpdate(role, patterns, u); err != nil {
187 return err
188 }
189 }
190 return nil
191}
192
193// InjectSecret meldt of een CI-job dit geheim als omgevingsvariabele krijgt.
194// Een beschermd geheim gaat alleen mee als de pipeline op een beschermde
195// branch draait. Onbeschermde geheimen gaan met elke job mee.
196// Dit is onafhankelijk van de UI: een ontwikkelaar leest geheimen nooit
197// terug, ook al belanden ze in een job die zijn pipeline startte.
198func InjectSecret(secretProtected, refProtected bool) bool {
199 if secretProtected {
200 return refProtected
201 }
202 return true
203}
204
205// ValidSecretName eist een omgevingsvariabelenaam.
206func ValidSecretName(name string) error {
207 if name == "" || len(name) > 80 {
208 return fmt.Errorf("geheimnaam moet 1 tot 80 tekens zijn")
209 }
210 for i, c := range name {
211 ok := c == '_' || (c >= 'A' && c <= 'Z') || (i > 0 && c >= '0' && c <= '9')
212 if !ok {
213 return fmt.Errorf("geheimnaam %q moet [A-Z][A-Z0-9_]* zijn", name)
214 }
215 }
216 return nil
217}
internal/access/access_test.go added +128 −0
@@ -0,0 +1,128 @@
1 package access
2
3 import "testing"
4
5 func TestParseAndRank(t *testing.T) {
6 cases := []struct {
7 in string
8 role Role
9 rank int
10 }{
11 {"readonly", RoleReadonly, 1},
12 {"Developer", RoleDeveloper, 2},
13 {" maintainer ", RoleMaintainer, 3},
14 }
15 for _, tc := range cases {
16 got, err := ParseRole(tc.in)
17 if err != nil {
18 t.Fatalf("ParseRole(%q): %v", tc.in, err)
19 }
20 if got != tc.role || got.Rank() != tc.rank {
21 t.Fatalf("ParseRole(%q)=%s rank %d", tc.in, got, got.Rank())
22 }
23 }
24 if _, err := ParseRole("owner"); err == nil {
25 t.Fatal("owner hoort geen rol te zijn")
26 }
27 if Max(RoleReadonly, RoleDeveloper) != RoleDeveloper {
28 t.Fatal("max")
29 }
30 if Max(RoleMaintainer, RoleReadonly) != RoleMaintainer {
31 t.Fatal("max maintainer")
32 }
33 }
34
35 func TestResolve(t *testing.T) {
36 if Resolve(Input{UserOwner: true}) != RoleMaintainer {
37 t.Fatal("eigenaar is beheerder")
38 }
39 got := Resolve(Input{GroupRole: RoleReadonly, RepoRole: RoleDeveloper})
40 if got != RoleDeveloper {
41 t.Fatalf("hoogste rol, kreeg %s", got)
42 }
43 got = Resolve(Input{GroupRole: RoleMaintainer, RepoRole: RoleReadonly})
44 if got != RoleMaintainer {
45 t.Fatalf("groepsbeheerder, kreeg %s", got)
46 }
47 if Resolve(Input{}) != RoleNone {
48 t.Fatal("geen lidmaatschap")
49 }
50 }
51
52 func TestCapabilities(t *testing.T) {
53 if RoleReadonly.CanWriteCode() || RoleReadonly.CanPushBranch(false) || RoleReadonly.CanManageSecrets() {
54 t.Fatal("alleen-lezen mag niet schrijven")
55 }
56 if !RoleDeveloper.CanPushBranch(false) {
57 t.Fatal("ontwikkelaar mag naar een gewone branch")
58 }
59 if RoleDeveloper.CanPushBranch(true) || RoleDeveloper.CanManageSecrets() || RoleDeveloper.CanManageSettings() {
60 t.Fatal("ontwikkelaar mag geen beschermde branch of geheim")
61 }
62 if !RoleMaintainer.CanPushBranch(true) || !RoleMaintainer.CanManageSecrets() || !RoleMaintainer.CanMerge(true) {
63 t.Fatal("beheerder mag alles")
64 }
65 if RoleDeveloper.CanMerge(true) || !RoleDeveloper.CanMerge(false) {
66 t.Fatal("samenvoegen volgt de branchregel")
67 }
68 }
69
70 func TestProtectedPatterns(t *testing.T) {
71 patterns := []string{"main", "release/*"}
72 if !BranchProtected(patterns, "main") || !BranchProtected(patterns, "release/1.2") {
73 t.Fatal("verwachte treffers")
74 }
75 if BranchProtected(patterns, "release/1.2/rc") || BranchProtected(patterns, "feature") {
76 t.Fatal("geen treffer verwacht")
77 }
78 }
79
80 func TestAuthorizeUpdate(t *testing.T) {
81 patterns := []string{"main"}
82 dev := []RefUpdate{
83 {Old: zero, New: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", Ref: "refs/heads/feature"},
84 {Old: zero, New: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb", Ref: "refs/tags/v1"},
85 }
86 if err := AuthorizeUpdates(RoleDeveloper, patterns, dev); err != nil {
87 t.Fatal(err)
88 }
89 protected := []RefUpdate{{Old: zero, New: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", Ref: "refs/heads/main"}}
90 if err := AuthorizeUpdates(RoleDeveloper, patterns, protected); err == nil {
91 t.Fatal("ontwikkelaar mag main niet aanmaken")
92 }
93 if err := AuthorizeUpdates(RoleMaintainer, patterns, protected); err != nil {
94 t.Fatal(err)
95 }
96 if err := AuthorizeUpdates(RoleReadonly, patterns, dev); err == nil {
97 t.Fatal("alleen-lezen mag niet pushen")
98 }
99 del := []RefUpdate{{Old: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", New: zero, Ref: "refs/heads/main"}}
100 if err := AuthorizeUpdates(RoleDeveloper, patterns, del); err == nil {
101 t.Fatal("ontwikkelaar mag main niet verwijderen")
102 }
103 }
104
105 func TestInjectSecret(t *testing.T) {
106 if !InjectSecret(false, false) || !InjectSecret(false, true) {
107 t.Fatal("onbeschermd geheim gaat altijd mee")
108 }
109 if InjectSecret(true, false) {
110 t.Fatal("beschermd geheim niet op een gewone branch")
111 }
112 if !InjectSecret(true, true) {
113 t.Fatal("beschermd geheim wel op een beschermde branch")
114 }
115 }
116
117 func TestSecretName(t *testing.T) {
118 if err := ValidSecretName("DEPLOY_SSH_KEY"); err != nil {
119 t.Fatal(err)
120 }
121 for _, bad := range []string{"", "lower", "1KEY", "A-B", "HAS SPACE"} {
122 if err := ValidSecretName(bad); err == nil {
123 t.Fatalf("naam %q hoort afgekeurd", bad)
124 }
125 }
126 }
127
128 const zero = "0000000000000000000000000000000000000000"
@@ -0,0 +1,128 @@
1package access
2
3import "testing"
4
5func TestParseAndRank(t *testing.T) {
6 cases := []struct {
7 in string
8 role Role
9 rank int
10 }{
11 {"readonly", RoleReadonly, 1},
12 {"Developer", RoleDeveloper, 2},
13 {" maintainer ", RoleMaintainer, 3},
14 }
15 for _, tc := range cases {
16 got, err := ParseRole(tc.in)
17 if err != nil {
18 t.Fatalf("ParseRole(%q): %v", tc.in, err)
19 }
20 if got != tc.role || got.Rank() != tc.rank {
21 t.Fatalf("ParseRole(%q)=%s rank %d", tc.in, got, got.Rank())
22 }
23 }
24 if _, err := ParseRole("owner"); err == nil {
25 t.Fatal("owner hoort geen rol te zijn")
26 }
27 if Max(RoleReadonly, RoleDeveloper) != RoleDeveloper {
28 t.Fatal("max")
29 }
30 if Max(RoleMaintainer, RoleReadonly) != RoleMaintainer {
31 t.Fatal("max maintainer")
32 }
33}
34
35func TestResolve(t *testing.T) {
36 if Resolve(Input{UserOwner: true}) != RoleMaintainer {
37 t.Fatal("eigenaar is beheerder")
38 }
39 got := Resolve(Input{GroupRole: RoleReadonly, RepoRole: RoleDeveloper})
40 if got != RoleDeveloper {
41 t.Fatalf("hoogste rol, kreeg %s", got)
42 }
43 got = Resolve(Input{GroupRole: RoleMaintainer, RepoRole: RoleReadonly})
44 if got != RoleMaintainer {
45 t.Fatalf("groepsbeheerder, kreeg %s", got)
46 }
47 if Resolve(Input{}) != RoleNone {
48 t.Fatal("geen lidmaatschap")
49 }
50}
51
52func TestCapabilities(t *testing.T) {
53 if RoleReadonly.CanWriteCode() || RoleReadonly.CanPushBranch(false) || RoleReadonly.CanManageSecrets() {
54 t.Fatal("alleen-lezen mag niet schrijven")
55 }
56 if !RoleDeveloper.CanPushBranch(false) {
57 t.Fatal("ontwikkelaar mag naar een gewone branch")
58 }
59 if RoleDeveloper.CanPushBranch(true) || RoleDeveloper.CanManageSecrets() || RoleDeveloper.CanManageSettings() {
60 t.Fatal("ontwikkelaar mag geen beschermde branch of geheim")
61 }
62 if !RoleMaintainer.CanPushBranch(true) || !RoleMaintainer.CanManageSecrets() || !RoleMaintainer.CanMerge(true) {
63 t.Fatal("beheerder mag alles")
64 }
65 if RoleDeveloper.CanMerge(true) || !RoleDeveloper.CanMerge(false) {
66 t.Fatal("samenvoegen volgt de branchregel")
67 }
68}
69
70func TestProtectedPatterns(t *testing.T) {
71 patterns := []string{"main", "release/*"}
72 if !BranchProtected(patterns, "main") || !BranchProtected(patterns, "release/1.2") {
73 t.Fatal("verwachte treffers")
74 }
75 if BranchProtected(patterns, "release/1.2/rc") || BranchProtected(patterns, "feature") {
76 t.Fatal("geen treffer verwacht")
77 }
78}
79
80func TestAuthorizeUpdate(t *testing.T) {
81 patterns := []string{"main"}
82 dev := []RefUpdate{
83 {Old: zero, New: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", Ref: "refs/heads/feature"},
84 {Old: zero, New: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb", Ref: "refs/tags/v1"},
85 }
86 if err := AuthorizeUpdates(RoleDeveloper, patterns, dev); err != nil {
87 t.Fatal(err)
88 }
89 protected := []RefUpdate{{Old: zero, New: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", Ref: "refs/heads/main"}}
90 if err := AuthorizeUpdates(RoleDeveloper, patterns, protected); err == nil {
91 t.Fatal("ontwikkelaar mag main niet aanmaken")
92 }
93 if err := AuthorizeUpdates(RoleMaintainer, patterns, protected); err != nil {
94 t.Fatal(err)
95 }
96 if err := AuthorizeUpdates(RoleReadonly, patterns, dev); err == nil {
97 t.Fatal("alleen-lezen mag niet pushen")
98 }
99 del := []RefUpdate{{Old: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", New: zero, Ref: "refs/heads/main"}}
100 if err := AuthorizeUpdates(RoleDeveloper, patterns, del); err == nil {
101 t.Fatal("ontwikkelaar mag main niet verwijderen")
102 }
103}
104
105func TestInjectSecret(t *testing.T) {
106 if !InjectSecret(false, false) || !InjectSecret(false, true) {
107 t.Fatal("onbeschermd geheim gaat altijd mee")
108 }
109 if InjectSecret(true, false) {
110 t.Fatal("beschermd geheim niet op een gewone branch")
111 }
112 if !InjectSecret(true, true) {
113 t.Fatal("beschermd geheim wel op een beschermde branch")
114 }
115}
116
117func TestSecretName(t *testing.T) {
118 if err := ValidSecretName("DEPLOY_SSH_KEY"); err != nil {
119 t.Fatal(err)
120 }
121 for _, bad := range []string{"", "lower", "1KEY", "A-B", "HAS SPACE"} {
122 if err := ValidSecretName(bad); err == nil {
123 t.Fatalf("naam %q hoort afgekeurd", bad)
124 }
125 }
126}
127
128const zero = "0000000000000000000000000000000000000000"
internal/auth/auth.go added +229 −0
@@ -0,0 +1,229 @@
1 // Package auth praat met auth.timfalken.com.
2 // De site gebruikt de authorization-code-flow: het domein is de client_id,
3 // de code wordt server-side gewisseld, en /api/me levert id en gebruikersnaam.
4 // E-mail komt nooit mee. Er is geen lokaal wachtwoord.
5 package auth
6
7 import (
8 "context"
9 "encoding/json"
10 "fmt"
11 "io"
12 "net/http"
13 "net/url"
14 "strings"
15 "time"
16 )
17
18 // Identity is het account dat een verbonden site mag zien.
19 type Identity struct {
20 AuthID int64
21 Username string
22 AvatarURL string
23 IsAdmin bool
24 EmailVerified bool
25 AccessToken string
26 ExpiresIn int
27 }
28
29 // Provider is de auth-server, of een testvervanger.
30 type Provider interface {
31 AuthorizeURL(state, redirectURI string) string
32 Exchange(ctx context.Context, code, redirectURI string) (Identity, error)
33 Extend(ctx context.Context, accessToken string) (expiresIn int, err error)
34 Logout(ctx context.Context, accessToken string) error
35 }
36
37 // TimFalken is de client voor https://auth.timfalken.com.
38 type TimFalken struct {
39 BaseURL string
40 ClientID string
41 Secret string
42 UserAgent string
43 HTTP *http.Client
44 }
45
46 // NewTimFalken maakt een client. baseURL is zonder slash aan het eind.
47 func NewTimFalken(baseURL, clientID, secret, userAgent string) *TimFalken {
48 return &TimFalken{
49 BaseURL: strings.TrimRight(baseURL, "/"),
50 ClientID: clientID,
51 Secret: secret,
52 UserAgent: userAgent,
53 HTTP: &http.Client{Timeout: 15 * time.Second},
54 }
55 }
56
57 // AuthorizeURL stuurt de browser naar de toestemmingspagina.
58 func (t *TimFalken) AuthorizeURL(state, redirectURI string) string {
59 q := url.Values{}
60 q.Set("client_id", t.ClientID)
61 q.Set("redirect_uri", redirectURI)
62 q.Set("response_type", "code")
63 q.Set("state", state)
64 return t.BaseURL + "/oauth/authorize?" + q.Encode()
65 }
66
67 // Exchange wisselt de eenmalige code om voor een bearer-token.
68 func (t *TimFalken) Exchange(ctx context.Context, code, redirectURI string) (Identity, error) {
69 form := url.Values{}
70 form.Set("grant_type", "authorization_code")
71 form.Set("code", code)
72 form.Set("redirect_uri", redirectURI)
73 form.Set("client_id", t.ClientID)
74 form.Set("client_secret", t.Secret)
75 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/oauth/token", strings.NewReader(form.Encode()))
76 if err != nil {
77 return Identity{}, err
78 }
79 req.Header.Set("Content-Type", "application/x-www-form-urlencoded")
80 req.Header.Set("Accept", "application/json")
81 req.Header.Set("User-Agent", t.UserAgent)
82 var body struct {
83 AccessToken string `json:"access_token"`
84 TokenType string `json:"token_type"`
85 ExpiresIn int `json:"expires_in"`
86 Error string `json:"error"`
87 User struct {
88 ID int64 `json:"id"`
89 Username string `json:"username"`
90 AvatarURL string `json:"avatar_url"`
91 } `json:"user"`
92 }
93 if err := t.do(req, &body); err != nil {
94 return Identity{}, err
95 }
96 if body.Error != "" || body.AccessToken == "" || body.User.ID == 0 {
97 msg := body.Error
98 if msg == "" {
99 msg = "lege tokenrespons"
100 }
101 return Identity{}, fmt.Errorf("auth: %s", msg)
102 }
103 id := Identity{
104 AuthID: body.User.ID,
105 Username: strings.ToLower(body.User.Username),
106 AvatarURL: body.User.AvatarURL,
107 AccessToken: body.AccessToken,
108 ExpiresIn: body.ExpiresIn,
109 }
110 // /api/me vult is_admin en email_verified aan. Dat is admin van de
111 // auth-server, niet van BlueGit.
112 me, err := t.me(ctx, body.AccessToken)
113 if err != nil {
114 return id, nil
115 }
116 id.IsAdmin = me.IsAdmin
117 id.EmailVerified = me.EmailVerified
118 if me.Username != "" {
119 id.Username = strings.ToLower(me.Username)
120 }
121 if me.AvatarURL != "" {
122 id.AvatarURL = me.AvatarURL
123 }
124 return id, nil
125 }
126
127 type meUser struct {
128 ID int64 `json:"id"`
129 Username string `json:"username"`
130 IsAdmin bool `json:"is_admin"`
131 EmailVerified bool `json:"email_verified"`
132 AvatarURL string `json:"avatar_url"`
133 }
134
135 func (t *TimFalken) me(ctx context.Context, token string) (meUser, error) {
136 req, err := http.NewRequestWithContext(ctx, http.MethodGet, t.BaseURL+"/api/me", nil)
137 if err != nil {
138 return meUser{}, err
139 }
140 t.bearer(req, token)
141 var body struct {
142 User meUser `json:"user"`
143 Error string `json:"error"`
144 }
145 if err := t.do(req, &body); err != nil {
146 return meUser{}, err
147 }
148 if body.Error != "" {
149 return meUser{}, fmt.Errorf("auth: %s", body.Error)
150 }
151 return body.User, nil
152 }
153
154 // Extend schuift de sessie een volledige dag op.
155 func (t *TimFalken) Extend(ctx context.Context, accessToken string) (int, error) {
156 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/api/session/extend", nil)
157 if err != nil {
158 return 0, err
159 }
160 t.bearer(req, accessToken)
161 var body struct {
162 ExpiresIn int `json:"expires_in"`
163 Error string `json:"error"`
164 }
165 if err := t.do(req, &body); err != nil {
166 return 0, err
167 }
168 if body.Error != "" {
169 return 0, fmt.Errorf("auth: %s", body.Error)
170 }
171 if body.ExpiresIn <= 0 {
172 body.ExpiresIn = 86400
173 }
174 return body.ExpiresIn, nil
175 }
176
177 // Logout trekt het bearer-token in.
178 func (t *TimFalken) Logout(ctx context.Context, accessToken string) error {
179 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/api/logout", nil)
180 if err != nil {
181 return err
182 }
183 t.bearer(req, accessToken)
184 var body struct {
185 Error string `json:"error"`
186 }
187 if err := t.do(req, &body); err != nil {
188 return err
189 }
190 if body.Error != "" {
191 return fmt.Errorf("auth: %s", body.Error)
192 }
193 return nil
194 }
195
196 func (t *TimFalken) bearer(req *http.Request, token string) {
197 req.Header.Set("Authorization", "Bearer "+token)
198 req.Header.Set("Accept", "application/json")
199 req.Header.Set("User-Agent", t.UserAgent)
200 }
201
202 func (t *TimFalken) do(req *http.Request, dest any) error {
203 res, err := t.HTTP.Do(req)
204 if err != nil {
205 return fmt.Errorf("auth: %w", err)
206 }
207 defer res.Body.Close()
208 raw, err := io.ReadAll(io.LimitReader(res.Body, 1<<20))
209 if err != nil {
210 return err
211 }
212 if res.StatusCode >= 400 {
213 var env struct {
214 Error string `json:"error"`
215 }
216 _ = json.Unmarshal(raw, &env)
217 if env.Error == "" {
218 env.Error = res.Status
219 }
220 return fmt.Errorf("auth: %s", env.Error)
221 }
222 if dest == nil {
223 return nil
224 }
225 if err := json.Unmarshal(raw, dest); err != nil {
226 return fmt.Errorf("auth-antwoord: %w", err)
227 }
228 return nil
229 }
@@ -0,0 +1,229 @@
1// Package auth praat met auth.timfalken.com.
2// De site gebruikt de authorization-code-flow: het domein is de client_id,
3// de code wordt server-side gewisseld, en /api/me levert id en gebruikersnaam.
4// E-mail komt nooit mee. Er is geen lokaal wachtwoord.
5package auth
6
7import (
8 "context"
9 "encoding/json"
10 "fmt"
11 "io"
12 "net/http"
13 "net/url"
14 "strings"
15 "time"
16)
17
18// Identity is het account dat een verbonden site mag zien.
19type Identity struct {
20 AuthID int64
21 Username string
22 AvatarURL string
23 IsAdmin bool
24 EmailVerified bool
25 AccessToken string
26 ExpiresIn int
27}
28
29// Provider is de auth-server, of een testvervanger.
30type Provider interface {
31 AuthorizeURL(state, redirectURI string) string
32 Exchange(ctx context.Context, code, redirectURI string) (Identity, error)
33 Extend(ctx context.Context, accessToken string) (expiresIn int, err error)
34 Logout(ctx context.Context, accessToken string) error
35}
36
37// TimFalken is de client voor https://auth.timfalken.com.
38type TimFalken struct {
39 BaseURL string
40 ClientID string
41 Secret string
42 UserAgent string
43 HTTP *http.Client
44}
45
46// NewTimFalken maakt een client. baseURL is zonder slash aan het eind.
47func NewTimFalken(baseURL, clientID, secret, userAgent string) *TimFalken {
48 return &TimFalken{
49 BaseURL: strings.TrimRight(baseURL, "/"),
50 ClientID: clientID,
51 Secret: secret,
52 UserAgent: userAgent,
53 HTTP: &http.Client{Timeout: 15 * time.Second},
54 }
55}
56
57// AuthorizeURL stuurt de browser naar de toestemmingspagina.
58func (t *TimFalken) AuthorizeURL(state, redirectURI string) string {
59 q := url.Values{}
60 q.Set("client_id", t.ClientID)
61 q.Set("redirect_uri", redirectURI)
62 q.Set("response_type", "code")
63 q.Set("state", state)
64 return t.BaseURL + "/oauth/authorize?" + q.Encode()
65}
66
67// Exchange wisselt de eenmalige code om voor een bearer-token.
68func (t *TimFalken) Exchange(ctx context.Context, code, redirectURI string) (Identity, error) {
69 form := url.Values{}
70 form.Set("grant_type", "authorization_code")
71 form.Set("code", code)
72 form.Set("redirect_uri", redirectURI)
73 form.Set("client_id", t.ClientID)
74 form.Set("client_secret", t.Secret)
75 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/oauth/token", strings.NewReader(form.Encode()))
76 if err != nil {
77 return Identity{}, err
78 }
79 req.Header.Set("Content-Type", "application/x-www-form-urlencoded")
80 req.Header.Set("Accept", "application/json")
81 req.Header.Set("User-Agent", t.UserAgent)
82 var body struct {
83 AccessToken string `json:"access_token"`
84 TokenType string `json:"token_type"`
85 ExpiresIn int `json:"expires_in"`
86 Error string `json:"error"`
87 User struct {
88 ID int64 `json:"id"`
89 Username string `json:"username"`
90 AvatarURL string `json:"avatar_url"`
91 } `json:"user"`
92 }
93 if err := t.do(req, &body); err != nil {
94 return Identity{}, err
95 }
96 if body.Error != "" || body.AccessToken == "" || body.User.ID == 0 {
97 msg := body.Error
98 if msg == "" {
99 msg = "lege tokenrespons"
100 }
101 return Identity{}, fmt.Errorf("auth: %s", msg)
102 }
103 id := Identity{
104 AuthID: body.User.ID,
105 Username: strings.ToLower(body.User.Username),
106 AvatarURL: body.User.AvatarURL,
107 AccessToken: body.AccessToken,
108 ExpiresIn: body.ExpiresIn,
109 }
110 // /api/me vult is_admin en email_verified aan. Dat is admin van de
111 // auth-server, niet van BlueGit.
112 me, err := t.me(ctx, body.AccessToken)
113 if err != nil {
114 return id, nil
115 }
116 id.IsAdmin = me.IsAdmin
117 id.EmailVerified = me.EmailVerified
118 if me.Username != "" {
119 id.Username = strings.ToLower(me.Username)
120 }
121 if me.AvatarURL != "" {
122 id.AvatarURL = me.AvatarURL
123 }
124 return id, nil
125}
126
127type meUser struct {
128 ID int64 `json:"id"`
129 Username string `json:"username"`
130 IsAdmin bool `json:"is_admin"`
131 EmailVerified bool `json:"email_verified"`
132 AvatarURL string `json:"avatar_url"`
133}
134
135func (t *TimFalken) me(ctx context.Context, token string) (meUser, error) {
136 req, err := http.NewRequestWithContext(ctx, http.MethodGet, t.BaseURL+"/api/me", nil)
137 if err != nil {
138 return meUser{}, err
139 }
140 t.bearer(req, token)
141 var body struct {
142 User meUser `json:"user"`
143 Error string `json:"error"`
144 }
145 if err := t.do(req, &body); err != nil {
146 return meUser{}, err
147 }
148 if body.Error != "" {
149 return meUser{}, fmt.Errorf("auth: %s", body.Error)
150 }
151 return body.User, nil
152}
153
154// Extend schuift de sessie een volledige dag op.
155func (t *TimFalken) Extend(ctx context.Context, accessToken string) (int, error) {
156 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/api/session/extend", nil)
157 if err != nil {
158 return 0, err
159 }
160 t.bearer(req, accessToken)
161 var body struct {
162 ExpiresIn int `json:"expires_in"`
163 Error string `json:"error"`
164 }
165 if err := t.do(req, &body); err != nil {
166 return 0, err
167 }
168 if body.Error != "" {
169 return 0, fmt.Errorf("auth: %s", body.Error)
170 }
171 if body.ExpiresIn <= 0 {
172 body.ExpiresIn = 86400
173 }
174 return body.ExpiresIn, nil
175}
176
177// Logout trekt het bearer-token in.
178func (t *TimFalken) Logout(ctx context.Context, accessToken string) error {
179 req, err := http.NewRequestWithContext(ctx, http.MethodPost, t.BaseURL+"/api/logout", nil)
180 if err != nil {
181 return err
182 }
183 t.bearer(req, accessToken)
184 var body struct {
185 Error string `json:"error"`
186 }
187 if err := t.do(req, &body); err != nil {
188 return err
189 }
190 if body.Error != "" {
191 return fmt.Errorf("auth: %s", body.Error)
192 }
193 return nil
194}
195
196func (t *TimFalken) bearer(req *http.Request, token string) {
197 req.Header.Set("Authorization", "Bearer "+token)
198 req.Header.Set("Accept", "application/json")
199 req.Header.Set("User-Agent", t.UserAgent)
200}
201
202func (t *TimFalken) do(req *http.Request, dest any) error {
203 res, err := t.HTTP.Do(req)
204 if err != nil {
205 return fmt.Errorf("auth: %w", err)
206 }
207 defer res.Body.Close()
208 raw, err := io.ReadAll(io.LimitReader(res.Body, 1<<20))
209 if err != nil {
210 return err
211 }
212 if res.StatusCode >= 400 {
213 var env struct {
214 Error string `json:"error"`
215 }
216 _ = json.Unmarshal(raw, &env)
217 if env.Error == "" {
218 env.Error = res.Status
219 }
220 return fmt.Errorf("auth: %s", env.Error)
221 }
222 if dest == nil {
223 return nil
224 }
225 if err := json.Unmarshal(raw, dest); err != nil {
226 return fmt.Errorf("auth-antwoord: %w", err)
227 }
228 return nil
229}
internal/auth/auth_test.go added +51 −0
@@ -0,0 +1,51 @@
1 package auth
2
3 import (
4 "context"
5 "io"
6 "net/http"
7 "net/http/httptest"
8 "strings"
9 "testing"
10 )
11
12 func TestExchangeUsesAuthorizationCode(t *testing.T) {
13 var gotBody, gotAgent, gotAccept string
14 srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
15 gotAgent = r.Header.Get("User-Agent")
16 gotAccept = r.Header.Get("Accept")
17 w.Header().Set("Content-Type", "application/json")
18 switch r.URL.Path {
19 case "/oauth/token":
20 b, _ := io.ReadAll(r.Body)
21 gotBody = string(b)
22 _, _ = w.Write([]byte(`{"access_token":"tok","token_type":"Bearer","expires_in":86400,"user":{"id":7,"username":"Tim","avatar_url":"https://auth.timfalken.com/avatar/7?v=1"}}`))
23 case "/api/me":
24 if r.Header.Get("Authorization") != "Bearer tok" {
25 t.Errorf("bearer %s", r.Header.Get("Authorization"))
26 }
27 _, _ = w.Write([]byte(`{"user":{"id":7,"username":"tim","is_admin":false,"email_verified":true,"avatar_url":"https://auth.timfalken.com/avatar/7?v=1"}}`))
28 default:
29 http.NotFound(w, r)
30 }
31 }))
32 defer srv.Close()
33 client := NewTimFalken(srv.URL, "git.timfalken.com", "geheim", "BlueGitAccountClient/0.1")
34 id, err := client.Exchange(context.Background(), "code-1", "https://git.timfalken.com/auth/callback")
35 if err != nil {
36 t.Fatal(err)
37 }
38 if id.AuthID != 7 || id.Username != "tim" || id.AccessToken != "tok" || !id.EmailVerified {
39 t.Fatalf("%+v", id)
40 }
41 if !strings.Contains(gotBody, "grant_type=authorization_code") || !strings.Contains(gotBody, "client_id=git.timfalken.com") || !strings.Contains(gotBody, "code=code-1") {
42 t.Fatalf("body %s", gotBody)
43 }
44 if gotAgent != "BlueGitAccountClient/0.1" || gotAccept != "application/json" {
45 t.Fatalf("headers %s %s", gotAgent, gotAccept)
46 }
47 url := client.AuthorizeURL("state-1", "https://git.timfalken.com/auth/callback")
48 if !strings.Contains(url, "/oauth/authorize?") || !strings.Contains(url, "state=state-1") {
49 t.Fatal(url)
50 }
51 }
@@ -0,0 +1,51 @@
1package auth
2
3import (
4 "context"
5 "io"
6 "net/http"
7 "net/http/httptest"
8 "strings"
9 "testing"
10)
11
12func TestExchangeUsesAuthorizationCode(t *testing.T) {
13 var gotBody, gotAgent, gotAccept string
14 srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
15 gotAgent = r.Header.Get("User-Agent")
16 gotAccept = r.Header.Get("Accept")
17 w.Header().Set("Content-Type", "application/json")
18 switch r.URL.Path {
19 case "/oauth/token":
20 b, _ := io.ReadAll(r.Body)
21 gotBody = string(b)
22 _, _ = w.Write([]byte(`{"access_token":"tok","token_type":"Bearer","expires_in":86400,"user":{"id":7,"username":"Tim","avatar_url":"https://auth.timfalken.com/avatar/7?v=1"}}`))
23 case "/api/me":
24 if r.Header.Get("Authorization") != "Bearer tok" {
25 t.Errorf("bearer %s", r.Header.Get("Authorization"))
26 }
27 _, _ = w.Write([]byte(`{"user":{"id":7,"username":"tim","is_admin":false,"email_verified":true,"avatar_url":"https://auth.timfalken.com/avatar/7?v=1"}}`))
28 default:
29 http.NotFound(w, r)
30 }
31 }))
32 defer srv.Close()
33 client := NewTimFalken(srv.URL, "git.timfalken.com", "geheim", "BlueGitAccountClient/0.1")
34 id, err := client.Exchange(context.Background(), "code-1", "https://git.timfalken.com/auth/callback")
35 if err != nil {
36 t.Fatal(err)
37 }
38 if id.AuthID != 7 || id.Username != "tim" || id.AccessToken != "tok" || !id.EmailVerified {
39 t.Fatalf("%+v", id)
40 }
41 if !strings.Contains(gotBody, "grant_type=authorization_code") || !strings.Contains(gotBody, "client_id=git.timfalken.com") || !strings.Contains(gotBody, "code=code-1") {
42 t.Fatalf("body %s", gotBody)
43 }
44 if gotAgent != "BlueGitAccountClient/0.1" || gotAccept != "application/json" {
45 t.Fatalf("headers %s %s", gotAgent, gotAccept)
46 }
47 url := client.AuthorizeURL("state-1", "https://git.timfalken.com/auth/callback")
48 if !strings.Contains(url, "/oauth/authorize?") || !strings.Contains(url, "state=state-1") {
49 t.Fatal(url)
50 }
51}
internal/auth/dev.go added +42 −0
@@ -0,0 +1,42 @@
1 package auth
2
3 import (
4 "context"
5 "fmt"
6 )
7
8 // Dev is een lokale vervanger zonder wachtwoord.
9 // Hij mag niet aanstaan op git.timfalken.com. De configuratie weigert dat.
10 type Dev struct {
11 Username string
12 AuthID int64
13 }
14
15 // AuthorizeURL komt in de dev-modus niet voor: /login maakt meteen een sessie.
16 func (d Dev) AuthorizeURL(state, redirectURI string) string { return "/login" }
17
18 // Exchange bestaat zodat de interface klopt. Dev-login gebruikt hem niet.
19 func (d Dev) Exchange(ctx context.Context, code, redirectURI string) (Identity, error) {
20 if code != "dev" {
21 return Identity{}, fmt.Errorf("dev-auth accepteert alleen de lokale code")
22 }
23 return d.identity(), nil
24 }
25
26 // Extend houdt de lokale sessie in leven zonder de auth-server.
27 func (d Dev) Extend(ctx context.Context, accessToken string) (int, error) {
28 return 86400, nil
29 }
30
31 // Logout doet niets op afstand.
32 func (d Dev) Logout(ctx context.Context, accessToken string) error { return nil }
33
34 func (d Dev) identity() Identity {
35 return Identity{
36 AuthID: d.AuthID,
37 Username: d.Username,
38 AccessToken: "dev-token",
39 ExpiresIn: 86400,
40 EmailVerified: true,
41 }
42 }
@@ -0,0 +1,42 @@
1package auth
2
3import (
4 "context"
5 "fmt"
6)
7
8// Dev is een lokale vervanger zonder wachtwoord.
9// Hij mag niet aanstaan op git.timfalken.com. De configuratie weigert dat.
10type Dev struct {
11 Username string
12 AuthID int64
13}
14
15// AuthorizeURL komt in de dev-modus niet voor: /login maakt meteen een sessie.
16func (d Dev) AuthorizeURL(state, redirectURI string) string { return "/login" }
17
18// Exchange bestaat zodat de interface klopt. Dev-login gebruikt hem niet.
19func (d Dev) Exchange(ctx context.Context, code, redirectURI string) (Identity, error) {
20 if code != "dev" {
21 return Identity{}, fmt.Errorf("dev-auth accepteert alleen de lokale code")
22 }
23 return d.identity(), nil
24}
25
26// Extend houdt de lokale sessie in leven zonder de auth-server.
27func (d Dev) Extend(ctx context.Context, accessToken string) (int, error) {
28 return 86400, nil
29}
30
31// Logout doet niets op afstand.
32func (d Dev) Logout(ctx context.Context, accessToken string) error { return nil }
33
34func (d Dev) identity() Identity {
35 return Identity{
36 AuthID: d.AuthID,
37 Username: d.Username,
38 AccessToken: "dev-token",
39 ExpiresIn: 86400,
40 EmailVerified: true,
41 }
42}
internal/ci/example_test.go added +34 −0
@@ -0,0 +1,34 @@
1 package ci
2
3 import (
4 "os"
5 "testing"
6 )
7
8 func TestBlueGitExampleFile(t *testing.T) {
9 raw, err := os.ReadFile("../../blue-ci-cd.yml")
10 if err != nil {
11 t.Fatal(err)
12 }
13 p, err := Parse(raw)
14 if err != nil {
15 t.Fatal(err)
16 }
17 if len(p.Jobs) != 4 {
18 t.Fatalf("jobs %d", len(p.Jobs))
19 }
20 active, err := p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "feature"})
21 if err != nil {
22 t.Fatal(err)
23 }
24 if len(active) != 2 {
25 t.Fatalf("feature hoort alleen test en build te doen, kreeg %d", len(active))
26 }
27 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "master"})
28 if err != nil || len(active) != 4 {
29 t.Fatalf("master %d %v", len(active), err)
30 }
31 if Gate(p.Jobs, map[string]string{"test": "success", "build": "success", "release": "queued", "deploy": "queued"}, p.Jobs[3]) != "wait" {
32 t.Fatal("deploy wacht op release")
33 }
34 }
@@ -0,0 +1,34 @@
1package ci
2
3import (
4 "os"
5 "testing"
6)
7
8func TestBlueGitExampleFile(t *testing.T) {
9 raw, err := os.ReadFile("../../blue-ci-cd.yml")
10 if err != nil {
11 t.Fatal(err)
12 }
13 p, err := Parse(raw)
14 if err != nil {
15 t.Fatal(err)
16 }
17 if len(p.Jobs) != 4 {
18 t.Fatalf("jobs %d", len(p.Jobs))
19 }
20 active, err := p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "feature"})
21 if err != nil {
22 t.Fatal(err)
23 }
24 if len(active) != 2 {
25 t.Fatalf("feature hoort alleen test en build te doen, kreeg %d", len(active))
26 }
27 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "master"})
28 if err != nil || len(active) != 4 {
29 t.Fatalf("master %d %v", len(active), err)
30 }
31 if Gate(p.Jobs, map[string]string{"test": "success", "build": "success", "release": "queued", "deploy": "queued"}, p.Jobs[3]) != "wait" {
32 t.Fatal("deploy wacht op release")
33 }
34}
internal/ci/parse.go added +568 −0
@@ -0,0 +1,568 @@
1 // Package ci leest blue-ci-cd.yml en bepaalt welke jobs draaien.
2 // De vorm ligt dicht bij GitLab CI: stages, jobs, needs, rules, artifacts.
3 package ci
4
5 import (
6 "fmt"
7 "regexp"
8 "strconv"
9 "strings"
10 "time"
11
12 "gopkg.in/yaml.v3"
13 )
14
15 // Pipeline is een geparset configuratiebestand.
16 type Pipeline struct {
17 Stages []string
18 Variables map[string]string
19 Image string
20 Jobs []Job
21 }
22
23 // Job is één containerstap.
24 type Job struct {
25 Name string
26 Stage string
27 Image string
28 Script []string
29 Needs []string
30 NeedsSet bool
31 Variables map[string]string
32 Artifacts Artifacts
33 Rules []Rule
34 AllowFailure bool
35 }
36
37 // Artifacts zijn paden die na een geslaagde job bewaard blijven.
38 type Artifacts struct {
39 Paths []string
40 ExpireIn time.Duration
41 }
42
43 // Rule is één voorwaarde. De job draait als minstens één rule klopt.
44 // Zonder rules draait de job altijd.
45 type Rule struct {
46 If string
47 }
48
49 // Parse leest YAML. Jobvolgorde blijft de volgorde uit het bestand.
50 func Parse(data []byte) (Pipeline, error) {
51 var root yaml.Node
52 if err := yaml.Unmarshal(data, &root); err != nil {
53 return Pipeline{}, fmt.Errorf("yaml: %w", err)
54 }
55 if root.Kind != yaml.DocumentNode || len(root.Content) != 1 || root.Content[0].Kind != yaml.MappingNode {
56 return Pipeline{}, fmt.Errorf("blue-ci-cd.yml moet een mapping zijn")
57 }
58 body := root.Content[0]
59 var p Pipeline
60 p.Variables = map[string]string{}
61 for i := 0; i < len(body.Content); i += 2 {
62 key := body.Content[i].Value
63 val := body.Content[i+1]
64 switch key {
65 case "stages":
66 stages, err := scalarList(val)
67 if err != nil {
68 return Pipeline{}, fmt.Errorf("stages: %w", err)
69 }
70 p.Stages = stages
71 case "variables":
72 vars, err := scalarMap(val)
73 if err != nil {
74 return Pipeline{}, fmt.Errorf("variables: %w", err)
75 }
76 p.Variables = vars
77 case "image":
78 if val.Kind != yaml.ScalarNode {
79 return Pipeline{}, fmt.Errorf("image moet een tekst zijn")
80 }
81 p.Image = val.Value
82 case "jobs":
83 jobs, err := parseJobs(val)
84 if err != nil {
85 return Pipeline{}, err
86 }
87 p.Jobs = jobs
88 default:
89 return Pipeline{}, fmt.Errorf("onbekend veld %q", key)
90 }
91 }
92 if err := p.validate(); err != nil {
93 return Pipeline{}, err
94 }
95 return p, nil
96 }
97
98 func parseJobs(node *yaml.Node) ([]Job, error) {
99 if node.Kind != yaml.MappingNode {
100 return nil, fmt.Errorf("jobs moet een mapping zijn")
101 }
102 var jobs []Job
103 for i := 0; i < len(node.Content); i += 2 {
104 name := node.Content[i].Value
105 body := node.Content[i+1]
106 job, err := parseJob(name, body)
107 if err != nil {
108 return nil, fmt.Errorf("job %s: %w", name, err)
109 }
110 jobs = append(jobs, job)
111 }
112 return jobs, nil
113 }
114
115 func parseJob(name string, node *yaml.Node) (Job, error) {
116 if node.Kind != yaml.MappingNode {
117 return Job{}, fmt.Errorf("moet een mapping zijn")
118 }
119 j := Job{Name: name, Variables: map[string]string{}}
120 for i := 0; i < len(node.Content); i += 2 {
121 key := node.Content[i].Value
122 val := node.Content[i+1]
123 switch key {
124 case "stage":
125 if val.Kind != yaml.ScalarNode {
126 return Job{}, fmt.Errorf("stage moet tekst zijn")
127 }
128 j.Stage = val.Value
129 case "image":
130 if val.Kind != yaml.ScalarNode {
131 return Job{}, fmt.Errorf("image moet tekst zijn")
132 }
133 j.Image = val.Value
134 case "script":
135 lines, err := scalarList(val)
136 if err != nil {
137 return Job{}, fmt.Errorf("script: %w", err)
138 }
139 j.Script = lines
140 case "needs":
141 needs, err := scalarList(val)
142 if err != nil {
143 return Job{}, fmt.Errorf("needs: %w", err)
144 }
145 j.Needs = needs
146 j.NeedsSet = true
147 case "variables":
148 vars, err := scalarMap(val)
149 if err != nil {
150 return Job{}, fmt.Errorf("variables: %w", err)
151 }
152 j.Variables = vars
153 case "artifacts":
154 art, err := parseArtifacts(val)
155 if err != nil {
156 return Job{}, err
157 }
158 j.Artifacts = art
159 case "rules":
160 rules, err := parseRules(val)
161 if err != nil {
162 return Job{}, err
163 }
164 j.Rules = rules
165 case "allow_failure":
166 b, err := parseBool(val)
167 if err != nil {
168 return Job{}, fmt.Errorf("allow_failure: %w", err)
169 }
170 j.AllowFailure = b
171 default:
172 return Job{}, fmt.Errorf("onbekend veld %q", key)
173 }
174 }
175 return j, nil
176 }
177
178 func parseArtifacts(node *yaml.Node) (Artifacts, error) {
179 if node.Kind != yaml.MappingNode {
180 return Artifacts{}, fmt.Errorf("artifacts moet een mapping zijn")
181 }
182 var a Artifacts
183 for i := 0; i < len(node.Content); i += 2 {
184 key := node.Content[i].Value
185 val := node.Content[i+1]
186 switch key {
187 case "paths":
188 paths, err := scalarList(val)
189 if err != nil {
190 return Artifacts{}, fmt.Errorf("artifacts.paths: %w", err)
191 }
192 a.Paths = paths
193 case "expire_in":
194 if val.Kind != yaml.ScalarNode {
195 return Artifacts{}, fmt.Errorf("expire_in moet tekst zijn")
196 }
197 d, err := parseExpire(val.Value)
198 if err != nil {
199 return Artifacts{}, err
200 }
201 a.ExpireIn = d
202 default:
203 return Artifacts{}, fmt.Errorf("onbekend artifacts-veld %q", key)
204 }
205 }
206 return a, nil
207 }
208
209 func parseRules(node *yaml.Node) ([]Rule, error) {
210 if node.Kind != yaml.SequenceNode {
211 return nil, fmt.Errorf("rules moet een lijst zijn")
212 }
213 var rules []Rule
214 for _, item := range node.Content {
215 if item.Kind != yaml.MappingNode {
216 return nil, fmt.Errorf("rule moet een mapping zijn")
217 }
218 var r Rule
219 for i := 0; i < len(item.Content); i += 2 {
220 key := item.Content[i].Value
221 val := item.Content[i+1]
222 if key != "if" {
223 return nil, fmt.Errorf("rule ondersteunt alleen if, kreeg %q", key)
224 }
225 if val.Kind != yaml.ScalarNode || strings.TrimSpace(val.Value) == "" {
226 return nil, fmt.Errorf("rule.if moet tekst zijn")
227 }
228 r.If = strings.TrimSpace(val.Value)
229 }
230 if r.If == "" {
231 return nil, fmt.Errorf("rule mist if")
232 }
233 if _, err := compileRule(r.If); err != nil {
234 return nil, err
235 }
236 rules = append(rules, r)
237 }
238 return rules, nil
239 }
240
241 func (p *Pipeline) validate() error {
242 if len(p.Jobs) == 0 {
243 return fmt.Errorf("geen jobs")
244 }
245 seenStage := map[string]bool{}
246 for _, s := range p.Stages {
247 if s == "" {
248 return fmt.Errorf("lege stage-naam")
249 }
250 if seenStage[s] {
251 return fmt.Errorf("dubbele stage %q", s)
252 }
253 seenStage[s] = true
254 }
255 if len(p.Stages) == 0 {
256 var order []string
257 have := map[string]bool{}
258 for i := range p.Jobs {
259 if p.Jobs[i].Stage == "" {
260 p.Jobs[i].Stage = "test"
261 }
262 if !have[p.Jobs[i].Stage] {
263 have[p.Jobs[i].Stage] = true
264 order = append(order, p.Jobs[i].Stage)
265 }
266 }
267 p.Stages = order
268 for _, s := range p.Stages {
269 seenStage[s] = true
270 }
271 }
272 names := map[string]bool{}
273 for i := range p.Jobs {
274 j := &p.Jobs[i]
275 if j.Name == "" || strings.ContainsAny(j.Name, " \t\n/\\") {
276 return fmt.Errorf("ongeldige jobnaam %q", j.Name)
277 }
278 if names[j.Name] {
279 return fmt.Errorf("dubbele job %q", j.Name)
280 }
281 names[j.Name] = true
282 if j.Stage == "" {
283 return fmt.Errorf("job %s mist stage", j.Name)
284 }
285 if !seenStage[j.Stage] {
286 return fmt.Errorf("job %s gebruikt onbekende stage %q", j.Name, j.Stage)
287 }
288 if j.Image == "" {
289 j.Image = p.Image
290 }
291 if strings.TrimSpace(j.Image) == "" || strings.ContainsAny(j.Image, " \t\n") {
292 return fmt.Errorf("job %s mist een image", j.Name)
293 }
294 if len(j.Script) == 0 {
295 return fmt.Errorf("job %s mist script", j.Name)
296 }
297 for _, line := range j.Script {
298 if strings.TrimSpace(line) == "" {
299 return fmt.Errorf("job %s heeft een lege scriptregel", j.Name)
300 }
301 }
302 for _, path := range j.Artifacts.Paths {
303 if err := safeRelPath(path); err != nil {
304 return fmt.Errorf("job %s artifact: %w", j.Name, err)
305 }
306 }
307 }
308 for _, j := range p.Jobs {
309 for _, need := range j.Needs {
310 if !names[need] {
311 return fmt.Errorf("job %s needs onbekende job %q", j.Name, need)
312 }
313 if need == j.Name {
314 return fmt.Errorf("job %s kan niet van zichzelf afhangen", j.Name)
315 }
316 }
317 }
318 if err := detectCycles(p.Jobs); err != nil {
319 return err
320 }
321 return nil
322 }
323
324 func detectCycles(jobs []Job) error {
325 idx := map[string]int{}
326 for i, j := range jobs {
327 idx[j.Name] = i
328 }
329 const (
330 white = 0
331 gray = 1
332 black = 2
333 )
334 color := make([]int, len(jobs))
335 var visit func(int) error
336 visit = func(i int) error {
337 if color[i] == gray {
338 return fmt.Errorf("cyclus in needs bij job %s", jobs[i].Name)
339 }
340 if color[i] == black {
341 return nil
342 }
343 color[i] = gray
344 for _, n := range jobs[i].Needs {
345 if err := visit(idx[n]); err != nil {
346 return err
347 }
348 }
349 color[i] = black
350 return nil
351 }
352 for i := range jobs {
353 if err := visit(i); err != nil {
354 return err
355 }
356 }
357 return nil
358 }
359
360 // ActiveJobs filtert jobs waarvan de rules niet kloppen.
361 func (p Pipeline) ActiveJobs(env map[string]string) ([]Job, error) {
362 var out []Job
363 for _, j := range p.Jobs {
364 ok, err := j.matches(env)
365 if err != nil {
366 return nil, fmt.Errorf("job %s: %w", j.Name, err)
367 }
368 if ok {
369 out = append(out, j)
370 }
371 }
372 return out, nil
373 }
374
375 func (j Job) matches(env map[string]string) (bool, error) {
376 if len(j.Rules) == 0 {
377 return true, nil
378 }
379 for _, r := range j.Rules {
380 ok, err := evalRule(r.If, env)
381 if err != nil {
382 return false, err
383 }
384 if ok {
385 return true, nil
386 }
387 }
388 return false, nil
389 }
390
391 // Gate beslist of een job mag starten.
392 // "ready" betekent dat alle voorgangers klaar zijn.
393 // "wait" betekent dat er nog een voorganger loopt of in de wachtrij staat.
394 // "skip" betekent dat een voorganger mislukte zonder allow_failure.
395 //
396 // NeedsSet volgt de genoemde jobs, ook als de lijst leeg is.
397 // Zonder needs wacht de job op alle jobs in eerdere stages.
398 func Gate(jobs []Job, status map[string]string, job Job) string {
399 byName := map[string]Job{}
400 for _, j := range jobs {
401 byName[j.Name] = j
402 }
403 var deps []Job
404 if job.NeedsSet {
405 for _, n := range job.Needs {
406 deps = append(deps, byName[n])
407 }
408 } else {
409 stagePos := map[string]int{}
410 order := 0
411 for _, j := range jobs {
412 if _, ok := stagePos[j.Stage]; !ok {
413 stagePos[j.Stage] = order
414 order++
415 }
416 }
417 my := stagePos[job.Stage]
418 for _, j := range jobs {
419 if stagePos[j.Stage] < my {
420 deps = append(deps, j)
421 }
422 }
423 }
424 for _, d := range deps {
425 switch status[d.Name] {
426 case "success", "skipped":
427 continue
428 case "failed":
429 if d.AllowFailure {
430 continue
431 }
432 return "skip"
433 default:
434 return "wait"
435 }
436 }
437 return "ready"
438 }
439
440 var (
441 reEq = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*==\s*"([^"]*)"$`)
442 reNe = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*!=\s*"([^"]*)"$`)
443 reRe = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*=~\s*/(.+)/$`)
444 )
445
446 type compiledRule struct {
447 kind string
448 name string
449 arg string
450 re *regexp.Regexp
451 }
452
453 func compileRule(expr string) (compiledRule, error) {
454 if m := reEq.FindStringSubmatch(expr); m != nil {
455 return compiledRule{kind: "eq", name: m[1], arg: m[2]}, nil
456 }
457 if m := reNe.FindStringSubmatch(expr); m != nil {
458 return compiledRule{kind: "ne", name: m[1], arg: m[2]}, nil
459 }
460 if m := reRe.FindStringSubmatch(expr); m != nil {
461 re, err := regexp.Compile(m[2])
462 if err != nil {
463 return compiledRule{}, fmt.Errorf("ongeldige regex in rule %q: %w", expr, err)
464 }
465 return compiledRule{kind: "re", name: m[1], re: re}, nil
466 }
467 return compiledRule{}, fmt.Errorf("rule %q wordt niet begrepen", expr)
468 }
469
470 func evalRule(expr string, env map[string]string) (bool, error) {
471 c, err := compileRule(expr)
472 if err != nil {
473 return false, err
474 }
475 val := env[c.name]
476 switch c.kind {
477 case "eq":
478 return val == c.arg, nil
479 case "ne":
480 return val != c.arg, nil
481 case "re":
482 return c.re.MatchString(val), nil
483 default:
484 return false, fmt.Errorf("interne rulefout")
485 }
486 }
487
488 func parseExpire(s string) (time.Duration, error) {
489 s = strings.TrimSpace(s)
490 if s == "" || s == "never" {
491 return 0, nil
492 }
493 if len(s) < 2 {
494 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
495 }
496 n, err := strconv.Atoi(s[:len(s)-1])
497 if err != nil || n < 0 {
498 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
499 }
500 switch s[len(s)-1] {
501 case 'm':
502 return time.Duration(n) * time.Minute, nil
503 case 'h':
504 return time.Duration(n) * time.Hour, nil
505 case 'd':
506 return time.Duration(n) * 24 * time.Hour, nil
507 case 'w':
508 return time.Duration(n) * 7 * 24 * time.Hour, nil
509 default:
510 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
511 }
512 }
513
514 func scalarList(node *yaml.Node) ([]string, error) {
515 if node.Kind != yaml.SequenceNode {
516 return nil, fmt.Errorf("verwacht een lijst")
517 }
518 var out []string
519 for _, item := range node.Content {
520 if item.Kind != yaml.ScalarNode {
521 return nil, fmt.Errorf("lijst mag alleen tekst bevatten")
522 }
523 out = append(out, item.Value)
524 }
525 return out, nil
526 }
527
528 func scalarMap(node *yaml.Node) (map[string]string, error) {
529 if node.Kind != yaml.MappingNode {
530 return nil, fmt.Errorf("verwacht een mapping")
531 }
532 out := map[string]string{}
533 for i := 0; i < len(node.Content); i += 2 {
534 k := node.Content[i]
535 v := node.Content[i+1]
536 if k.Kind != yaml.ScalarNode || v.Kind != yaml.ScalarNode {
537 return nil, fmt.Errorf("variabelen moeten tekst zijn")
538 }
539 out[k.Value] = v.Value
540 }
541 return out, nil
542 }
543
544 func parseBool(node *yaml.Node) (bool, error) {
545 if node.Kind != yaml.ScalarNode {
546 return false, fmt.Errorf("verwacht ja of nee")
547 }
548 switch strings.ToLower(node.Value) {
549 case "true", "yes", "ja":
550 return true, nil
551 case "false", "no", "nee":
552 return false, nil
553 default:
554 return false, fmt.Errorf("verwacht true of false")
555 }
556 }
557
558 func safeRelPath(p string) error {
559 if p == "" || strings.HasPrefix(p, "/") || strings.Contains(p, "\\") {
560 return fmt.Errorf("pad %q moet relatief zijn", p)
561 }
562 for _, part := range strings.Split(p, "/") {
563 if part == ".." {
564 return fmt.Errorf("pad %q mag niet buiten de workspace", p)
565 }
566 }
567 return nil
568 }
@@ -0,0 +1,568 @@
1// Package ci leest blue-ci-cd.yml en bepaalt welke jobs draaien.
2// De vorm ligt dicht bij GitLab CI: stages, jobs, needs, rules, artifacts.
3package ci
4
5import (
6 "fmt"
7 "regexp"
8 "strconv"
9 "strings"
10 "time"
11
12 "gopkg.in/yaml.v3"
13)
14
15// Pipeline is een geparset configuratiebestand.
16type Pipeline struct {
17 Stages []string
18 Variables map[string]string
19 Image string
20 Jobs []Job
21}
22
23// Job is één containerstap.
24type Job struct {
25 Name string
26 Stage string
27 Image string
28 Script []string
29 Needs []string
30 NeedsSet bool
31 Variables map[string]string
32 Artifacts Artifacts
33 Rules []Rule
34 AllowFailure bool
35}
36
37// Artifacts zijn paden die na een geslaagde job bewaard blijven.
38type Artifacts struct {
39 Paths []string
40 ExpireIn time.Duration
41}
42
43// Rule is één voorwaarde. De job draait als minstens één rule klopt.
44// Zonder rules draait de job altijd.
45type Rule struct {
46 If string
47}
48
49// Parse leest YAML. Jobvolgorde blijft de volgorde uit het bestand.
50func Parse(data []byte) (Pipeline, error) {
51 var root yaml.Node
52 if err := yaml.Unmarshal(data, &root); err != nil {
53 return Pipeline{}, fmt.Errorf("yaml: %w", err)
54 }
55 if root.Kind != yaml.DocumentNode || len(root.Content) != 1 || root.Content[0].Kind != yaml.MappingNode {
56 return Pipeline{}, fmt.Errorf("blue-ci-cd.yml moet een mapping zijn")
57 }
58 body := root.Content[0]
59 var p Pipeline
60 p.Variables = map[string]string{}
61 for i := 0; i < len(body.Content); i += 2 {
62 key := body.Content[i].Value
63 val := body.Content[i+1]
64 switch key {
65 case "stages":
66 stages, err := scalarList(val)
67 if err != nil {
68 return Pipeline{}, fmt.Errorf("stages: %w", err)
69 }
70 p.Stages = stages
71 case "variables":
72 vars, err := scalarMap(val)
73 if err != nil {
74 return Pipeline{}, fmt.Errorf("variables: %w", err)
75 }
76 p.Variables = vars
77 case "image":
78 if val.Kind != yaml.ScalarNode {
79 return Pipeline{}, fmt.Errorf("image moet een tekst zijn")
80 }
81 p.Image = val.Value
82 case "jobs":
83 jobs, err := parseJobs(val)
84 if err != nil {
85 return Pipeline{}, err
86 }
87 p.Jobs = jobs
88 default:
89 return Pipeline{}, fmt.Errorf("onbekend veld %q", key)
90 }
91 }
92 if err := p.validate(); err != nil {
93 return Pipeline{}, err
94 }
95 return p, nil
96}
97
98func parseJobs(node *yaml.Node) ([]Job, error) {
99 if node.Kind != yaml.MappingNode {
100 return nil, fmt.Errorf("jobs moet een mapping zijn")
101 }
102 var jobs []Job
103 for i := 0; i < len(node.Content); i += 2 {
104 name := node.Content[i].Value
105 body := node.Content[i+1]
106 job, err := parseJob(name, body)
107 if err != nil {
108 return nil, fmt.Errorf("job %s: %w", name, err)
109 }
110 jobs = append(jobs, job)
111 }
112 return jobs, nil
113}
114
115func parseJob(name string, node *yaml.Node) (Job, error) {
116 if node.Kind != yaml.MappingNode {
117 return Job{}, fmt.Errorf("moet een mapping zijn")
118 }
119 j := Job{Name: name, Variables: map[string]string{}}
120 for i := 0; i < len(node.Content); i += 2 {
121 key := node.Content[i].Value
122 val := node.Content[i+1]
123 switch key {
124 case "stage":
125 if val.Kind != yaml.ScalarNode {
126 return Job{}, fmt.Errorf("stage moet tekst zijn")
127 }
128 j.Stage = val.Value
129 case "image":
130 if val.Kind != yaml.ScalarNode {
131 return Job{}, fmt.Errorf("image moet tekst zijn")
132 }
133 j.Image = val.Value
134 case "script":
135 lines, err := scalarList(val)
136 if err != nil {
137 return Job{}, fmt.Errorf("script: %w", err)
138 }
139 j.Script = lines
140 case "needs":
141 needs, err := scalarList(val)
142 if err != nil {
143 return Job{}, fmt.Errorf("needs: %w", err)
144 }
145 j.Needs = needs
146 j.NeedsSet = true
147 case "variables":
148 vars, err := scalarMap(val)
149 if err != nil {
150 return Job{}, fmt.Errorf("variables: %w", err)
151 }
152 j.Variables = vars
153 case "artifacts":
154 art, err := parseArtifacts(val)
155 if err != nil {
156 return Job{}, err
157 }
158 j.Artifacts = art
159 case "rules":
160 rules, err := parseRules(val)
161 if err != nil {
162 return Job{}, err
163 }
164 j.Rules = rules
165 case "allow_failure":
166 b, err := parseBool(val)
167 if err != nil {
168 return Job{}, fmt.Errorf("allow_failure: %w", err)
169 }
170 j.AllowFailure = b
171 default:
172 return Job{}, fmt.Errorf("onbekend veld %q", key)
173 }
174 }
175 return j, nil
176}
177
178func parseArtifacts(node *yaml.Node) (Artifacts, error) {
179 if node.Kind != yaml.MappingNode {
180 return Artifacts{}, fmt.Errorf("artifacts moet een mapping zijn")
181 }
182 var a Artifacts
183 for i := 0; i < len(node.Content); i += 2 {
184 key := node.Content[i].Value
185 val := node.Content[i+1]
186 switch key {
187 case "paths":
188 paths, err := scalarList(val)
189 if err != nil {
190 return Artifacts{}, fmt.Errorf("artifacts.paths: %w", err)
191 }
192 a.Paths = paths
193 case "expire_in":
194 if val.Kind != yaml.ScalarNode {
195 return Artifacts{}, fmt.Errorf("expire_in moet tekst zijn")
196 }
197 d, err := parseExpire(val.Value)
198 if err != nil {
199 return Artifacts{}, err
200 }
201 a.ExpireIn = d
202 default:
203 return Artifacts{}, fmt.Errorf("onbekend artifacts-veld %q", key)
204 }
205 }
206 return a, nil
207}
208
209func parseRules(node *yaml.Node) ([]Rule, error) {
210 if node.Kind != yaml.SequenceNode {
211 return nil, fmt.Errorf("rules moet een lijst zijn")
212 }
213 var rules []Rule
214 for _, item := range node.Content {
215 if item.Kind != yaml.MappingNode {
216 return nil, fmt.Errorf("rule moet een mapping zijn")
217 }
218 var r Rule
219 for i := 0; i < len(item.Content); i += 2 {
220 key := item.Content[i].Value
221 val := item.Content[i+1]
222 if key != "if" {
223 return nil, fmt.Errorf("rule ondersteunt alleen if, kreeg %q", key)
224 }
225 if val.Kind != yaml.ScalarNode || strings.TrimSpace(val.Value) == "" {
226 return nil, fmt.Errorf("rule.if moet tekst zijn")
227 }
228 r.If = strings.TrimSpace(val.Value)
229 }
230 if r.If == "" {
231 return nil, fmt.Errorf("rule mist if")
232 }
233 if _, err := compileRule(r.If); err != nil {
234 return nil, err
235 }
236 rules = append(rules, r)
237 }
238 return rules, nil
239}
240
241func (p *Pipeline) validate() error {
242 if len(p.Jobs) == 0 {
243 return fmt.Errorf("geen jobs")
244 }
245 seenStage := map[string]bool{}
246 for _, s := range p.Stages {
247 if s == "" {
248 return fmt.Errorf("lege stage-naam")
249 }
250 if seenStage[s] {
251 return fmt.Errorf("dubbele stage %q", s)
252 }
253 seenStage[s] = true
254 }
255 if len(p.Stages) == 0 {
256 var order []string
257 have := map[string]bool{}
258 for i := range p.Jobs {
259 if p.Jobs[i].Stage == "" {
260 p.Jobs[i].Stage = "test"
261 }
262 if !have[p.Jobs[i].Stage] {
263 have[p.Jobs[i].Stage] = true
264 order = append(order, p.Jobs[i].Stage)
265 }
266 }
267 p.Stages = order
268 for _, s := range p.Stages {
269 seenStage[s] = true
270 }
271 }
272 names := map[string]bool{}
273 for i := range p.Jobs {
274 j := &p.Jobs[i]
275 if j.Name == "" || strings.ContainsAny(j.Name, " \t\n/\\") {
276 return fmt.Errorf("ongeldige jobnaam %q", j.Name)
277 }
278 if names[j.Name] {
279 return fmt.Errorf("dubbele job %q", j.Name)
280 }
281 names[j.Name] = true
282 if j.Stage == "" {
283 return fmt.Errorf("job %s mist stage", j.Name)
284 }
285 if !seenStage[j.Stage] {
286 return fmt.Errorf("job %s gebruikt onbekende stage %q", j.Name, j.Stage)
287 }
288 if j.Image == "" {
289 j.Image = p.Image
290 }
291 if strings.TrimSpace(j.Image) == "" || strings.ContainsAny(j.Image, " \t\n") {
292 return fmt.Errorf("job %s mist een image", j.Name)
293 }
294 if len(j.Script) == 0 {
295 return fmt.Errorf("job %s mist script", j.Name)
296 }
297 for _, line := range j.Script {
298 if strings.TrimSpace(line) == "" {
299 return fmt.Errorf("job %s heeft een lege scriptregel", j.Name)
300 }
301 }
302 for _, path := range j.Artifacts.Paths {
303 if err := safeRelPath(path); err != nil {
304 return fmt.Errorf("job %s artifact: %w", j.Name, err)
305 }
306 }
307 }
308 for _, j := range p.Jobs {
309 for _, need := range j.Needs {
310 if !names[need] {
311 return fmt.Errorf("job %s needs onbekende job %q", j.Name, need)
312 }
313 if need == j.Name {
314 return fmt.Errorf("job %s kan niet van zichzelf afhangen", j.Name)
315 }
316 }
317 }
318 if err := detectCycles(p.Jobs); err != nil {
319 return err
320 }
321 return nil
322}
323
324func detectCycles(jobs []Job) error {
325 idx := map[string]int{}
326 for i, j := range jobs {
327 idx[j.Name] = i
328 }
329 const (
330 white = 0
331 gray = 1
332 black = 2
333 )
334 color := make([]int, len(jobs))
335 var visit func(int) error
336 visit = func(i int) error {
337 if color[i] == gray {
338 return fmt.Errorf("cyclus in needs bij job %s", jobs[i].Name)
339 }
340 if color[i] == black {
341 return nil
342 }
343 color[i] = gray
344 for _, n := range jobs[i].Needs {
345 if err := visit(idx[n]); err != nil {
346 return err
347 }
348 }
349 color[i] = black
350 return nil
351 }
352 for i := range jobs {
353 if err := visit(i); err != nil {
354 return err
355 }
356 }
357 return nil
358}
359
360// ActiveJobs filtert jobs waarvan de rules niet kloppen.
361func (p Pipeline) ActiveJobs(env map[string]string) ([]Job, error) {
362 var out []Job
363 for _, j := range p.Jobs {
364 ok, err := j.matches(env)
365 if err != nil {
366 return nil, fmt.Errorf("job %s: %w", j.Name, err)
367 }
368 if ok {
369 out = append(out, j)
370 }
371 }
372 return out, nil
373}
374
375func (j Job) matches(env map[string]string) (bool, error) {
376 if len(j.Rules) == 0 {
377 return true, nil
378 }
379 for _, r := range j.Rules {
380 ok, err := evalRule(r.If, env)
381 if err != nil {
382 return false, err
383 }
384 if ok {
385 return true, nil
386 }
387 }
388 return false, nil
389}
390
391// Gate beslist of een job mag starten.
392// "ready" betekent dat alle voorgangers klaar zijn.
393// "wait" betekent dat er nog een voorganger loopt of in de wachtrij staat.
394// "skip" betekent dat een voorganger mislukte zonder allow_failure.
395//
396// NeedsSet volgt de genoemde jobs, ook als de lijst leeg is.
397// Zonder needs wacht de job op alle jobs in eerdere stages.
398func Gate(jobs []Job, status map[string]string, job Job) string {
399 byName := map[string]Job{}
400 for _, j := range jobs {
401 byName[j.Name] = j
402 }
403 var deps []Job
404 if job.NeedsSet {
405 for _, n := range job.Needs {
406 deps = append(deps, byName[n])
407 }
408 } else {
409 stagePos := map[string]int{}
410 order := 0
411 for _, j := range jobs {
412 if _, ok := stagePos[j.Stage]; !ok {
413 stagePos[j.Stage] = order
414 order++
415 }
416 }
417 my := stagePos[job.Stage]
418 for _, j := range jobs {
419 if stagePos[j.Stage] < my {
420 deps = append(deps, j)
421 }
422 }
423 }
424 for _, d := range deps {
425 switch status[d.Name] {
426 case "success", "skipped":
427 continue
428 case "failed":
429 if d.AllowFailure {
430 continue
431 }
432 return "skip"
433 default:
434 return "wait"
435 }
436 }
437 return "ready"
438}
439
440var (
441 reEq = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*==\s*"([^"]*)"$`)
442 reNe = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*!=\s*"([^"]*)"$`)
443 reRe = regexp.MustCompile(`^\$([A-Za-z_][A-Za-z0-9_]*)\s*=~\s*/(.+)/$`)
444)
445
446type compiledRule struct {
447 kind string
448 name string
449 arg string
450 re *regexp.Regexp
451}
452
453func compileRule(expr string) (compiledRule, error) {
454 if m := reEq.FindStringSubmatch(expr); m != nil {
455 return compiledRule{kind: "eq", name: m[1], arg: m[2]}, nil
456 }
457 if m := reNe.FindStringSubmatch(expr); m != nil {
458 return compiledRule{kind: "ne", name: m[1], arg: m[2]}, nil
459 }
460 if m := reRe.FindStringSubmatch(expr); m != nil {
461 re, err := regexp.Compile(m[2])
462 if err != nil {
463 return compiledRule{}, fmt.Errorf("ongeldige regex in rule %q: %w", expr, err)
464 }
465 return compiledRule{kind: "re", name: m[1], re: re}, nil
466 }
467 return compiledRule{}, fmt.Errorf("rule %q wordt niet begrepen", expr)
468}
469
470func evalRule(expr string, env map[string]string) (bool, error) {
471 c, err := compileRule(expr)
472 if err != nil {
473 return false, err
474 }
475 val := env[c.name]
476 switch c.kind {
477 case "eq":
478 return val == c.arg, nil
479 case "ne":
480 return val != c.arg, nil
481 case "re":
482 return c.re.MatchString(val), nil
483 default:
484 return false, fmt.Errorf("interne rulefout")
485 }
486}
487
488func parseExpire(s string) (time.Duration, error) {
489 s = strings.TrimSpace(s)
490 if s == "" || s == "never" {
491 return 0, nil
492 }
493 if len(s) < 2 {
494 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
495 }
496 n, err := strconv.Atoi(s[:len(s)-1])
497 if err != nil || n < 0 {
498 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
499 }
500 switch s[len(s)-1] {
501 case 'm':
502 return time.Duration(n) * time.Minute, nil
503 case 'h':
504 return time.Duration(n) * time.Hour, nil
505 case 'd':
506 return time.Duration(n) * 24 * time.Hour, nil
507 case 'w':
508 return time.Duration(n) * 7 * 24 * time.Hour, nil
509 default:
510 return 0, fmt.Errorf("expire_in %q is ongeldig", s)
511 }
512}
513
514func scalarList(node *yaml.Node) ([]string, error) {
515 if node.Kind != yaml.SequenceNode {
516 return nil, fmt.Errorf("verwacht een lijst")
517 }
518 var out []string
519 for _, item := range node.Content {
520 if item.Kind != yaml.ScalarNode {
521 return nil, fmt.Errorf("lijst mag alleen tekst bevatten")
522 }
523 out = append(out, item.Value)
524 }
525 return out, nil
526}
527
528func scalarMap(node *yaml.Node) (map[string]string, error) {
529 if node.Kind != yaml.MappingNode {
530 return nil, fmt.Errorf("verwacht een mapping")
531 }
532 out := map[string]string{}
533 for i := 0; i < len(node.Content); i += 2 {
534 k := node.Content[i]
535 v := node.Content[i+1]
536 if k.Kind != yaml.ScalarNode || v.Kind != yaml.ScalarNode {
537 return nil, fmt.Errorf("variabelen moeten tekst zijn")
538 }
539 out[k.Value] = v.Value
540 }
541 return out, nil
542}
543
544func parseBool(node *yaml.Node) (bool, error) {
545 if node.Kind != yaml.ScalarNode {
546 return false, fmt.Errorf("verwacht ja of nee")
547 }
548 switch strings.ToLower(node.Value) {
549 case "true", "yes", "ja":
550 return true, nil
551 case "false", "no", "nee":
552 return false, nil
553 default:
554 return false, fmt.Errorf("verwacht true of false")
555 }
556}
557
558func safeRelPath(p string) error {
559 if p == "" || strings.HasPrefix(p, "/") || strings.Contains(p, "\\") {
560 return fmt.Errorf("pad %q moet relatief zijn", p)
561 }
562 for _, part := range strings.Split(p, "/") {
563 if part == ".." {
564 return fmt.Errorf("pad %q mag niet buiten de workspace", p)
565 }
566 }
567 return nil
568}
internal/ci/parse_test.go added +157 −0
@@ -0,0 +1,157 @@
1 package ci
2
3 import (
4 "strings"
5 "testing"
6 "time"
7 )
8
9 const sample = `
10 image: alpine:3.20
11 stages: [test, build, release]
12 variables:
13 CGO_ENABLED: "0"
14 jobs:
15 test:
16 stage: test
17 image: golang:1.22
18 script:
19 - go test ./...
20 build:
21 stage: build
22 needs: [test]
23 script:
24 - go build -o bluegit ./cmd/bluegit
25 artifacts:
26 paths: [bluegit]
27 expire_in: 14d
28 release:
29 stage: release
30 needs: [build]
31 rules:
32 - if: $CI_COMMIT_BRANCH == "master"
33 - if: $CI_COMMIT_BRANCH =~ /^release\/.*/
34 script:
35 - echo release
36 `
37
38 func TestParseSample(t *testing.T) {
39 p, err := Parse([]byte(sample))
40 if err != nil {
41 t.Fatal(err)
42 }
43 if len(p.Jobs) != 3 {
44 t.Fatalf("jobs %d", len(p.Jobs))
45 }
46 if p.Jobs[1].Image != "alpine:3.20" {
47 t.Fatalf("image-default, kreeg %s", p.Jobs[1].Image)
48 }
49 if !p.Jobs[1].NeedsSet || len(p.Jobs[1].Needs) != 1 || p.Jobs[1].Needs[0] != "test" {
50 t.Fatalf("needs %+v", p.Jobs[1].Needs)
51 }
52 if p.Jobs[1].Artifacts.ExpireIn != 14*24*time.Hour {
53 t.Fatalf("expire %s", p.Jobs[1].Artifacts.ExpireIn)
54 }
55 if p.Variables["CGO_ENABLED"] != "0" {
56 t.Fatal("variabele")
57 }
58 active, err := p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "master"})
59 if err != nil || len(active) != 3 {
60 t.Fatalf("master: %d %v", len(active), err)
61 }
62 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "release/1"})
63 if err != nil || len(active) != 3 {
64 t.Fatalf("release branch: %d %v", len(active), err)
65 }
66 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "feature"})
67 if err != nil || len(active) != 2 {
68 t.Fatalf("feature hoort release over te slaan: %d %v", len(active), err)
69 }
70 }
71
72 func TestImplicitStageAndEmptyNeeds(t *testing.T) {
73 p, err := Parse([]byte(`
74 jobs:
75 a:
76 image: alpine
77 script: ["echo a"]
78 b:
79 image: alpine
80 stage: pakket
81 needs: []
82 script: ["echo b"]
83 `))
84 if err != nil {
85 t.Fatal(err)
86 }
87 if strings.Join(p.Stages, ",") != "test,pakket" {
88 t.Fatalf("stages %v", p.Stages)
89 }
90 if !p.Jobs[1].NeedsSet || len(p.Jobs[1].Needs) != 0 {
91 t.Fatal("lege needs horen gezet te zijn")
92 }
93 status := map[string]string{"a": "queued", "b": "queued"}
94 if Gate(p.Jobs, status, p.Jobs[1]) != "ready" {
95 t.Fatal("lege needs starten meteen")
96 }
97 if Gate(p.Jobs, status, p.Jobs[0]) != "ready" {
98 t.Fatal("eerste stage start meteen")
99 }
100 // Een job in een latere stage zonder needs wacht.
101 p2, err := Parse([]byte(`
102 stages: [een, twee]
103 jobs:
104 a:
105 stage: een
106 image: alpine
107 script: ["echo a"]
108 b:
109 stage: twee
110 image: alpine
111 script: ["echo b"]
112 `))
113 if err != nil {
114 t.Fatal(err)
115 }
116 if Gate(p2.Jobs, map[string]string{"a": "running", "b": "queued"}, p2.Jobs[1]) != "wait" {
117 t.Fatal("latere stage wacht")
118 }
119 if Gate(p2.Jobs, map[string]string{"a": "success", "b": "queued"}, p2.Jobs[1]) != "ready" {
120 t.Fatal("latere stage na succes")
121 }
122 if Gate(p2.Jobs, map[string]string{"a": "skipped", "b": "queued"}, p2.Jobs[1]) != "ready" {
123 t.Fatal("overgeslagen telt als klaar")
124 }
125 if Gate(p2.Jobs, map[string]string{"a": "failed", "b": "queued"}, p2.Jobs[1]) != "skip" {
126 t.Fatal("mislukte voorganger slaat de rest over")
127 }
128 }
129
130 func TestRejects(t *testing.T) {
131 cases := []string{
132 "jobs: {}\n",
133 "jobs:\n a:\n image: alpine\n script: []\n",
134 "stages: [test]\njobs:\n a:\n stage: nee\n image: alpine\n script: ['x']\n",
135 "stages: [test]\njobs:\n a:\n stage: test\n image: alpine\n needs: [b]\n script: ['x']\n",
136 "stages: [test]\njobs:\n a:\n stage: test\n image: alpine\n needs: [b]\n script: ['x']\n b:\n stage: test\n image: alpine\n needs: [a]\n script: ['y']\n",
137 "jobs:\n a:\n image: 'alpine image'\n script: ['x']\n",
138 "jobs:\n a:\n image: alpine\n script: ['x']\n artifacts:\n paths: ['../etc/passwd']\n",
139 "jobs:\n a:\n image: alpine\n script: ['x']\n rules:\n - if: 'niet geldig'\n",
140 }
141 for _, c := range cases {
142 if _, err := Parse([]byte(c)); err == nil {
143 t.Fatalf("hoorde afgekeurd:\n%s", c)
144 }
145 }
146 }
147
148 func TestRuleOperators(t *testing.T) {
149 ok, err := evalRule(`$CI_COMMIT_BRANCH != "master"`, map[string]string{"CI_COMMIT_BRANCH": "dev"})
150 if err != nil || !ok {
151 t.Fatalf("!=")
152 }
153 ok, err = evalRule(`$CI_COMMIT_BRANCH != "master"`, map[string]string{"CI_COMMIT_BRANCH": "master"})
154 if err != nil || ok {
155 t.Fatal("!= master")
156 }
157 }
@@ -0,0 +1,157 @@
1package ci
2
3import (
4 "strings"
5 "testing"
6 "time"
7)
8
9const sample = `
10image: alpine:3.20
11stages: [test, build, release]
12variables:
13 CGO_ENABLED: "0"
14jobs:
15 test:
16 stage: test
17 image: golang:1.22
18 script:
19 - go test ./...
20 build:
21 stage: build
22 needs: [test]
23 script:
24 - go build -o bluegit ./cmd/bluegit
25 artifacts:
26 paths: [bluegit]
27 expire_in: 14d
28 release:
29 stage: release
30 needs: [build]
31 rules:
32 - if: $CI_COMMIT_BRANCH == "master"
33 - if: $CI_COMMIT_BRANCH =~ /^release\/.*/
34 script:
35 - echo release
36`
37
38func TestParseSample(t *testing.T) {
39 p, err := Parse([]byte(sample))
40 if err != nil {
41 t.Fatal(err)
42 }
43 if len(p.Jobs) != 3 {
44 t.Fatalf("jobs %d", len(p.Jobs))
45 }
46 if p.Jobs[1].Image != "alpine:3.20" {
47 t.Fatalf("image-default, kreeg %s", p.Jobs[1].Image)
48 }
49 if !p.Jobs[1].NeedsSet || len(p.Jobs[1].Needs) != 1 || p.Jobs[1].Needs[0] != "test" {
50 t.Fatalf("needs %+v", p.Jobs[1].Needs)
51 }
52 if p.Jobs[1].Artifacts.ExpireIn != 14*24*time.Hour {
53 t.Fatalf("expire %s", p.Jobs[1].Artifacts.ExpireIn)
54 }
55 if p.Variables["CGO_ENABLED"] != "0" {
56 t.Fatal("variabele")
57 }
58 active, err := p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "master"})
59 if err != nil || len(active) != 3 {
60 t.Fatalf("master: %d %v", len(active), err)
61 }
62 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "release/1"})
63 if err != nil || len(active) != 3 {
64 t.Fatalf("release branch: %d %v", len(active), err)
65 }
66 active, err = p.ActiveJobs(map[string]string{"CI_COMMIT_BRANCH": "feature"})
67 if err != nil || len(active) != 2 {
68 t.Fatalf("feature hoort release over te slaan: %d %v", len(active), err)
69 }
70}
71
72func TestImplicitStageAndEmptyNeeds(t *testing.T) {
73 p, err := Parse([]byte(`
74jobs:
75 a:
76 image: alpine
77 script: ["echo a"]
78 b:
79 image: alpine
80 stage: pakket
81 needs: []
82 script: ["echo b"]
83`))
84 if err != nil {
85 t.Fatal(err)
86 }
87 if strings.Join(p.Stages, ",") != "test,pakket" {
88 t.Fatalf("stages %v", p.Stages)
89 }
90 if !p.Jobs[1].NeedsSet || len(p.Jobs[1].Needs) != 0 {
91 t.Fatal("lege needs horen gezet te zijn")
92 }
93 status := map[string]string{"a": "queued", "b": "queued"}
94 if Gate(p.Jobs, status, p.Jobs[1]) != "ready" {
95 t.Fatal("lege needs starten meteen")
96 }
97 if Gate(p.Jobs, status, p.Jobs[0]) != "ready" {
98 t.Fatal("eerste stage start meteen")
99 }
100 // Een job in een latere stage zonder needs wacht.
101 p2, err := Parse([]byte(`
102stages: [een, twee]
103jobs:
104 a:
105 stage: een
106 image: alpine
107 script: ["echo a"]
108 b:
109 stage: twee
110 image: alpine
111 script: ["echo b"]
112`))
113 if err != nil {
114 t.Fatal(err)
115 }
116 if Gate(p2.Jobs, map[string]string{"a": "running", "b": "queued"}, p2.Jobs[1]) != "wait" {
117 t.Fatal("latere stage wacht")
118 }
119 if Gate(p2.Jobs, map[string]string{"a": "success", "b": "queued"}, p2.Jobs[1]) != "ready" {
120 t.Fatal("latere stage na succes")
121 }
122 if Gate(p2.Jobs, map[string]string{"a": "skipped", "b": "queued"}, p2.Jobs[1]) != "ready" {
123 t.Fatal("overgeslagen telt als klaar")
124 }
125 if Gate(p2.Jobs, map[string]string{"a": "failed", "b": "queued"}, p2.Jobs[1]) != "skip" {
126 t.Fatal("mislukte voorganger slaat de rest over")
127 }
128}
129
130func TestRejects(t *testing.T) {
131 cases := []string{
132 "jobs: {}\n",
133 "jobs:\n a:\n image: alpine\n script: []\n",
134 "stages: [test]\njobs:\n a:\n stage: nee\n image: alpine\n script: ['x']\n",
135 "stages: [test]\njobs:\n a:\n stage: test\n image: alpine\n needs: [b]\n script: ['x']\n",
136 "stages: [test]\njobs:\n a:\n stage: test\n image: alpine\n needs: [b]\n script: ['x']\n b:\n stage: test\n image: alpine\n needs: [a]\n script: ['y']\n",
137 "jobs:\n a:\n image: 'alpine image'\n script: ['x']\n",
138 "jobs:\n a:\n image: alpine\n script: ['x']\n artifacts:\n paths: ['../etc/passwd']\n",
139 "jobs:\n a:\n image: alpine\n script: ['x']\n rules:\n - if: 'niet geldig'\n",
140 }
141 for _, c := range cases {
142 if _, err := Parse([]byte(c)); err == nil {
143 t.Fatalf("hoorde afgekeurd:\n%s", c)
144 }
145 }
146}
147
148func TestRuleOperators(t *testing.T) {
149 ok, err := evalRule(`$CI_COMMIT_BRANCH != "master"`, map[string]string{"CI_COMMIT_BRANCH": "dev"})
150 if err != nil || !ok {
151 t.Fatalf("!=")
152 }
153 ok, err = evalRule(`$CI_COMMIT_BRANCH != "master"`, map[string]string{"CI_COMMIT_BRANCH": "master"})
154 if err != nil || ok {
155 t.Fatal("!= master")
156 }
157}
internal/config/config.go added +311 −0
@@ -0,0 +1,311 @@
1 // Package config leest het YAML-configuratiebestand van BlueGit.
2 package config
3
4 import (
5 "fmt"
6 "net"
7 "net/url"
8 "os"
9 "strconv"
10 "strings"
11
12 "gitlab.com/Timfa/bluegit/internal/realip"
13 "gopkg.in/yaml.v3"
14 )
15
16 // Config is de installatie op de mini-PC.
17 type Config struct {
18 BaseURL string `yaml:"base_url"`
19 Listen string `yaml:"listen"`
20 // StatePath is de kleine map met database, sleutel en het gekozen
21 // opslagpad. Leeg wordt /var/lib/bluegit.
22 StatePath string `yaml:"state_path"`
23 // StoragePath is optioneel. Leeg betekent dat de beheerder het pad
24 // in de webinterface kiest. Er is geen standaardpad.
25 StoragePath string `yaml:"storage_path"`
26 TrustedProxies []string `yaml:"trusted_proxies"`
27 // BehindProxy is het oude veld. Het wordt geweigerd: één boolean
28 // vertrouwt ofwel iedereen, ofwel niemand. De lijst hierboven beslist.
29 BehindProxy bool `yaml:"behind_proxy"`
30 Auth Auth `yaml:"auth"`
31 Git Git `yaml:"git"`
32 SSH SSH `yaml:"ssh"`
33 CI CI `yaml:"ci"`
34
35 proxies *realip.Set
36 }
37
38 // Auth wijst naar auth.timfalken.com of naar de lokale ontwikkelmodus.
39 type Auth struct {
40 Mode string `yaml:"mode"`
41 BaseURL string `yaml:"base_url"`
42 ClientID string `yaml:"client_id"`
43 ClientSecret string `yaml:"client_secret"`
44 ClientSecretFile string `yaml:"client_secret_file"`
45 RedirectPath string `yaml:"redirect_path"`
46 UserAgent string `yaml:"user_agent"`
47 DevUser string `yaml:"dev_user"`
48 DevAuthID int64 `yaml:"dev_auth_id"`
49 }
50
51 // Git wijst naar de git-binary en de standaardbranch van nieuwe repositories.
52 type Git struct {
53 Binary string `yaml:"binary"`
54 DefaultBranch string `yaml:"default_branch"`
55 HookBinary string `yaml:"hook_binary"`
56 }
57
58 // SSH is de git-over-SSH-listener en het adres dat in clone-URL's staat.
59 // Listen is waar dit proces bindt. PublicHost en PublicPort zijn wat
60 // een gebruiker ziet; de ingress kan daar een andere poort voor gebruiken.
61 type SSH struct {
62 Enabled bool `yaml:"enabled"`
63 Listen string `yaml:"listen"`
64 PublicHost string `yaml:"public_host"`
65 PublicPort int `yaml:"public_port"`
66 }
67
68 // CI stuurt de Docker-runner.
69 type CI struct {
70 Enabled bool `yaml:"enabled"`
71 Docker string `yaml:"docker_binary"`
72 Concurrency int `yaml:"concurrency"`
73 Network string `yaml:"network"`
74 TimeoutSec int `yaml:"timeout_seconds"`
75 }
76
77 // Load leest path en vult ontbrekende waarden aan.
78 func Load(path string) (Config, error) {
79 raw, err := os.ReadFile(path)
80 if err != nil {
81 return Config{}, fmt.Errorf("config lezen: %w", err)
82 }
83 var c Config
84 if err := yaml.Unmarshal(raw, &c); err != nil {
85 return Config{}, fmt.Errorf("config: %w", err)
86 }
87 c.applyDefaults()
88 if v := os.Getenv("BLUEGIT_STATE_PATH"); v != "" {
89 c.StatePath = v
90 }
91 if v := os.Getenv("BLUEGIT_STORAGE_PATH"); v != "" {
92 c.StoragePath = v
93 }
94 if v := os.Getenv("BLUEGIT_LISTEN"); v != "" {
95 c.Listen = v
96 }
97 if v := os.Getenv("BLUEGIT_AUTH_CLIENT_SECRET"); v != "" {
98 c.Auth.ClientSecret = v
99 }
100 if c.Auth.ClientSecret == "" && c.Auth.ClientSecretFile != "" {
101 b, err := os.ReadFile(c.Auth.ClientSecretFile)
102 if err != nil {
103 return Config{}, fmt.Errorf("clientgeheim: %w", err)
104 }
105 c.Auth.ClientSecret = strings.TrimSpace(string(b))
106 }
107 if err := c.Validate(); err != nil {
108 return Config{}, err
109 }
110 return c, nil
111 }
112
113 func (c *Config) applyDefaults() {
114 if c.Listen == "" {
115 c.Listen = "127.0.0.1:8080"
116 }
117 if c.StatePath == "" {
118 c.StatePath = "/var/lib/bluegit"
119 }
120 if c.Auth.Mode == "" {
121 c.Auth.Mode = "oauth"
122 }
123 if c.Auth.BaseURL == "" {
124 c.Auth.BaseURL = "https://auth.timfalken.com"
125 }
126 if c.Auth.RedirectPath == "" {
127 c.Auth.RedirectPath = "/auth/callback"
128 }
129 if c.Auth.UserAgent == "" {
130 c.Auth.UserAgent = "BlueGitAccountClient/0.1"
131 }
132 if c.Auth.DevUser == "" {
133 c.Auth.DevUser = "tim"
134 }
135 if c.Auth.DevAuthID == 0 {
136 c.Auth.DevAuthID = 1
137 }
138 if c.Git.Binary == "" {
139 c.Git.Binary = "git"
140 }
141 if c.Git.DefaultBranch == "" {
142 c.Git.DefaultBranch = "master"
143 }
144 if c.SSH.Listen == "" {
145 c.SSH.Listen = "0.0.0.0:2222"
146 }
147 if c.CI.Docker == "" {
148 c.CI.Docker = "docker"
149 }
150 if c.CI.Concurrency <= 0 {
151 c.CI.Concurrency = 1
152 }
153 if c.CI.Network == "" {
154 c.CI.Network = "bridge"
155 }
156 if c.CI.TimeoutSec <= 0 {
157 c.CI.TimeoutSec = 1800
158 }
159 c.Auth.BaseURL = strings.TrimRight(c.Auth.BaseURL, "/")
160 c.BaseURL = strings.TrimRight(c.BaseURL, "/")
161 }
162
163 // Validate keurt een configuratie goed of af.
164 func (c *Config) Validate() error {
165 if c.BaseURL == "" {
166 return fmt.Errorf("base_url ontbreekt")
167 }
168 u, err := url.Parse(c.BaseURL)
169 if err != nil || (u.Scheme != "https" && u.Scheme != "http") || u.Host == "" {
170 return fmt.Errorf("base_url moet een absolute http(s)-URL zijn")
171 }
172 if strings.TrimSpace(c.StatePath) == "" {
173 return fmt.Errorf("state_path ontbreekt")
174 }
175 if !strings.HasPrefix(c.Auth.RedirectPath, "/") {
176 return fmt.Errorf("auth.redirect_path moet met / beginnen")
177 }
178 switch c.Auth.Mode {
179 case "oauth":
180 if c.Auth.ClientID == "" || c.Auth.ClientSecret == "" {
181 return fmt.Errorf("oauth vereist auth.client_id en een clientgeheim (veld, bestand of BLUEGIT_AUTH_CLIENT_SECRET)")
182 }
183 if c.Auth.BaseURL == "" {
184 return fmt.Errorf("auth.base_url ontbreekt")
185 }
186 case "dev":
187 if strings.EqualFold(u.Hostname(), "git.timfalken.com") {
188 return fmt.Errorf("auth.mode dev is geweigerd voor git.timfalken.com")
189 }
190 default:
191 return fmt.Errorf("auth.mode moet oauth of dev zijn")
192 }
193 if c.BehindProxy {
194 return fmt.Errorf("behind_proxy doet niets meer; zet trusted_proxies op het IP of CIDR van de ingress en haal behind_proxy weg")
195 }
196 set, err := realip.Parse(c.TrustedProxies)
197 if err != nil {
198 return err
199 }
200 c.proxies = set
201 if c.SSH.PublicPort < 0 || c.SSH.PublicPort > 65535 {
202 return fmt.Errorf("ssh.public_port moet tussen 0 en 65535 liggen")
203 }
204 if h := strings.TrimSpace(c.SSH.PublicHost); h != "" {
205 if strings.Contains(h, "://") || strings.ContainsAny(h, " /") || (strings.Contains(h, ":") && net.ParseIP(h) == nil) {
206 return fmt.Errorf("ssh.public_host moet een hostnaam of IP zijn, zonder schema of poort")
207 }
208 }
209 if _, _, err := net.SplitHostPort(c.SSH.Listen); err != nil {
210 return fmt.Errorf("ssh.listen moet host:poort zijn")
211 }
212 return nil
213 }
214
215 // ProxySet is de geparsede trusted_proxies-lijst. Nil betekent dat
216 // niemand vertrouwd wordt.
217 func (c Config) ProxySet() *realip.Set { return c.proxies }
218
219 // SSHPublicHost is de host in een SSH-clone-URL.
220 // Leeg in de config: de host van base_url.
221 func (c Config) SSHPublicHost() string {
222 if h := strings.TrimSpace(c.SSH.PublicHost); h != "" {
223 return h
224 }
225 u, err := url.Parse(c.BaseURL)
226 if err != nil {
227 return ""
228 }
229 return u.Hostname()
230 }
231
232 // SSHPublicPort is de poort in een SSH-clone-URL.
233 // 0 in de config: de poort van ssh.listen.
234 func (c Config) SSHPublicPort() int {
235 if c.SSH.PublicPort > 0 {
236 return c.SSH.PublicPort
237 }
238 _, port, err := net.SplitHostPort(c.SSH.Listen)
239 if err != nil {
240 return 22
241 }
242 n, err := strconv.Atoi(port)
243 if err != nil || n <= 0 {
244 return 22
245 }
246 return n
247 }
248
249 // CloneSSH is de URL die een gebruiker kloont. Leeg als SSH uit staat.
250 func (c Config) CloneSSH(repoPath string) string {
251 if !c.SSH.Enabled {
252 return ""
253 }
254 host := c.SSHPublicHost()
255 if strings.Contains(host, ":") && !strings.HasPrefix(host, "[") {
256 host = "[" + host + "]"
257 }
258 return fmt.Sprintf("ssh://git@%s:%d/%s.git", host, c.SSHPublicPort(), repoPath)
259 }
260
261 // RedirectURI is de callback die bij de auth-server geregistreerd moet staan.
262 func (c Config) RedirectURI() string {
263 return c.BaseURL + c.Auth.RedirectPath
264 }
265
266 // Example is een startconfiguratie voor de mini-PC.
267 func Example() string {
268 return `# BlueGit op de mini-PC. Kopieer naar /etc/bluegit/config.yml.
269 # Plain HTTP. TLS en de publieke SSH-poort doet de ingress, zie docs/INGRESS.md.
270 base_url: https://git.timfalken.com
271 listen: 0.0.0.0:8080
272 # Database, sleutel en het gekozen opslagpad. Dit is niet de datadisk.
273 state_path: /var/lib/bluegit
274 # storage_path blijft leeg. De installatiebeheerder kiest de datadisk
275 # bij de eerste aanmelding. Er is geen standaardpad.
276 # Alleen deze adressen mogen X-Forwarded-For en X-Real-IP zetten.
277 # Zet hier het IP van de ingress, zoals de mini-PC die verbinding ziet.
278 trusted_proxies:
279 - 10.0.0.2
280
281 auth:
282 mode: oauth
283 base_url: https://auth.timfalken.com
284 # Het domein is de client_id. Registreer het pad /auth/callback bij /admin.
285 client_id: git.timfalken.com
286 # Laat leeg en zet BLUEGIT_AUTH_CLIENT_SECRET, of gebruik client_secret_file.
287 client_secret: ""
288 client_secret_file: /etc/bluegit/client_secret
289 redirect_path: /auth/callback
290 user_agent: BlueGitAccountClient/0.1
291
292 git:
293 binary: git
294 default_branch: master
295
296 ssh:
297 enabled: true
298 # Waar dit proces git-SSH aanneemt. De SSH van het besturingssysteem blijft vrij.
299 listen: 0.0.0.0:2222
300 # Wat gebruikers in de clone-URL zien. De ingress stuurt poort 22 hiernaartoe.
301 public_host: git.timfalken.com
302 public_port: 22
303
304 ci:
305 enabled: true
306 docker_binary: docker
307 concurrency: 1
308 network: bridge
309 timeout_seconds: 1800
310 `
311 }
@@ -0,0 +1,311 @@
1// Package config leest het YAML-configuratiebestand van BlueGit.
2package config
3
4import (
5 "fmt"
6 "net"
7 "net/url"
8 "os"
9 "strconv"
10 "strings"
11
12 "gitlab.com/Timfa/bluegit/internal/realip"
13 "gopkg.in/yaml.v3"
14)
15
16// Config is de installatie op de mini-PC.
17type Config struct {
18 BaseURL string `yaml:"base_url"`
19 Listen string `yaml:"listen"`
20 // StatePath is de kleine map met database, sleutel en het gekozen
21 // opslagpad. Leeg wordt /var/lib/bluegit.
22 StatePath string `yaml:"state_path"`
23 // StoragePath is optioneel. Leeg betekent dat de beheerder het pad
24 // in de webinterface kiest. Er is geen standaardpad.
25 StoragePath string `yaml:"storage_path"`
26 TrustedProxies []string `yaml:"trusted_proxies"`
27 // BehindProxy is het oude veld. Het wordt geweigerd: één boolean
28 // vertrouwt ofwel iedereen, ofwel niemand. De lijst hierboven beslist.
29 BehindProxy bool `yaml:"behind_proxy"`
30 Auth Auth `yaml:"auth"`
31 Git Git `yaml:"git"`
32 SSH SSH `yaml:"ssh"`
33 CI CI `yaml:"ci"`
34
35 proxies *realip.Set
36}
37
38// Auth wijst naar auth.timfalken.com of naar de lokale ontwikkelmodus.
39type Auth struct {
40 Mode string `yaml:"mode"`
41 BaseURL string `yaml:"base_url"`
42 ClientID string `yaml:"client_id"`
43 ClientSecret string `yaml:"client_secret"`
44 ClientSecretFile string `yaml:"client_secret_file"`
45 RedirectPath string `yaml:"redirect_path"`
46 UserAgent string `yaml:"user_agent"`
47 DevUser string `yaml:"dev_user"`
48 DevAuthID int64 `yaml:"dev_auth_id"`
49}
50
51// Git wijst naar de git-binary en de standaardbranch van nieuwe repositories.
52type Git struct {
53 Binary string `yaml:"binary"`
54 DefaultBranch string `yaml:"default_branch"`
55 HookBinary string `yaml:"hook_binary"`
56}
57
58// SSH is de git-over-SSH-listener en het adres dat in clone-URL's staat.
59// Listen is waar dit proces bindt. PublicHost en PublicPort zijn wat
60// een gebruiker ziet; de ingress kan daar een andere poort voor gebruiken.
61type SSH struct {
62 Enabled bool `yaml:"enabled"`
63 Listen string `yaml:"listen"`
64 PublicHost string `yaml:"public_host"`
65 PublicPort int `yaml:"public_port"`
66}
67
68// CI stuurt de Docker-runner.
69type CI struct {
70 Enabled bool `yaml:"enabled"`
71 Docker string `yaml:"docker_binary"`
72 Concurrency int `yaml:"concurrency"`
73 Network string `yaml:"network"`
74 TimeoutSec int `yaml:"timeout_seconds"`
75}
76
77// Load leest path en vult ontbrekende waarden aan.
78func Load(path string) (Config, error) {
79 raw, err := os.ReadFile(path)
80 if err != nil {
81 return Config{}, fmt.Errorf("config lezen: %w", err)
82 }
83 var c Config
84 if err := yaml.Unmarshal(raw, &c); err != nil {
85 return Config{}, fmt.Errorf("config: %w", err)
86 }
87 c.applyDefaults()
88 if v := os.Getenv("BLUEGIT_STATE_PATH"); v != "" {
89 c.StatePath = v
90 }
91 if v := os.Getenv("BLUEGIT_STORAGE_PATH"); v != "" {
92 c.StoragePath = v
93 }
94 if v := os.Getenv("BLUEGIT_LISTEN"); v != "" {
95 c.Listen = v
96 }
97 if v := os.Getenv("BLUEGIT_AUTH_CLIENT_SECRET"); v != "" {
98 c.Auth.ClientSecret = v
99 }
100 if c.Auth.ClientSecret == "" && c.Auth.ClientSecretFile != "" {
101 b, err := os.ReadFile(c.Auth.ClientSecretFile)
102 if err != nil {
103 return Config{}, fmt.Errorf("clientgeheim: %w", err)
104 }
105 c.Auth.ClientSecret = strings.TrimSpace(string(b))
106 }
107 if err := c.Validate(); err != nil {
108 return Config{}, err
109 }
110 return c, nil
111}
112
113func (c *Config) applyDefaults() {
114 if c.Listen == "" {
115 c.Listen = "127.0.0.1:8080"
116 }
117 if c.StatePath == "" {
118 c.StatePath = "/var/lib/bluegit"
119 }
120 if c.Auth.Mode == "" {
121 c.Auth.Mode = "oauth"
122 }
123 if c.Auth.BaseURL == "" {
124 c.Auth.BaseURL = "https://auth.timfalken.com"
125 }
126 if c.Auth.RedirectPath == "" {
127 c.Auth.RedirectPath = "/auth/callback"
128 }
129 if c.Auth.UserAgent == "" {
130 c.Auth.UserAgent = "BlueGitAccountClient/0.1"
131 }
132 if c.Auth.DevUser == "" {
133 c.Auth.DevUser = "tim"
134 }
135 if c.Auth.DevAuthID == 0 {
136 c.Auth.DevAuthID = 1
137 }
138 if c.Git.Binary == "" {
139 c.Git.Binary = "git"
140 }
141 if c.Git.DefaultBranch == "" {
142 c.Git.DefaultBranch = "master"
143 }
144 if c.SSH.Listen == "" {
145 c.SSH.Listen = "0.0.0.0:2222"
146 }
147 if c.CI.Docker == "" {
148 c.CI.Docker = "docker"
149 }
150 if c.CI.Concurrency <= 0 {
151 c.CI.Concurrency = 1
152 }
153 if c.CI.Network == "" {
154 c.CI.Network = "bridge"
155 }
156 if c.CI.TimeoutSec <= 0 {
157 c.CI.TimeoutSec = 1800
158 }
159 c.Auth.BaseURL = strings.TrimRight(c.Auth.BaseURL, "/")
160 c.BaseURL = strings.TrimRight(c.BaseURL, "/")
161}
162
163// Validate keurt een configuratie goed of af.
164func (c *Config) Validate() error {
165 if c.BaseURL == "" {
166 return fmt.Errorf("base_url ontbreekt")
167 }
168 u, err := url.Parse(c.BaseURL)
169 if err != nil || (u.Scheme != "https" && u.Scheme != "http") || u.Host == "" {
170 return fmt.Errorf("base_url moet een absolute http(s)-URL zijn")
171 }
172 if strings.TrimSpace(c.StatePath) == "" {
173 return fmt.Errorf("state_path ontbreekt")
174 }
175 if !strings.HasPrefix(c.Auth.RedirectPath, "/") {
176 return fmt.Errorf("auth.redirect_path moet met / beginnen")
177 }
178 switch c.Auth.Mode {
179 case "oauth":
180 if c.Auth.ClientID == "" || c.Auth.ClientSecret == "" {
181 return fmt.Errorf("oauth vereist auth.client_id en een clientgeheim (veld, bestand of BLUEGIT_AUTH_CLIENT_SECRET)")
182 }
183 if c.Auth.BaseURL == "" {
184 return fmt.Errorf("auth.base_url ontbreekt")
185 }
186 case "dev":
187 if strings.EqualFold(u.Hostname(), "git.timfalken.com") {
188 return fmt.Errorf("auth.mode dev is geweigerd voor git.timfalken.com")
189 }
190 default:
191 return fmt.Errorf("auth.mode moet oauth of dev zijn")
192 }
193 if c.BehindProxy {
194 return fmt.Errorf("behind_proxy doet niets meer; zet trusted_proxies op het IP of CIDR van de ingress en haal behind_proxy weg")
195 }
196 set, err := realip.Parse(c.TrustedProxies)
197 if err != nil {
198 return err
199 }
200 c.proxies = set
201 if c.SSH.PublicPort < 0 || c.SSH.PublicPort > 65535 {
202 return fmt.Errorf("ssh.public_port moet tussen 0 en 65535 liggen")
203 }
204 if h := strings.TrimSpace(c.SSH.PublicHost); h != "" {
205 if strings.Contains(h, "://") || strings.ContainsAny(h, " /") || (strings.Contains(h, ":") && net.ParseIP(h) == nil) {
206 return fmt.Errorf("ssh.public_host moet een hostnaam of IP zijn, zonder schema of poort")
207 }
208 }
209 if _, _, err := net.SplitHostPort(c.SSH.Listen); err != nil {
210 return fmt.Errorf("ssh.listen moet host:poort zijn")
211 }
212 return nil
213}
214
215// ProxySet is de geparsede trusted_proxies-lijst. Nil betekent dat
216// niemand vertrouwd wordt.
217func (c Config) ProxySet() *realip.Set { return c.proxies }
218
219// SSHPublicHost is de host in een SSH-clone-URL.
220// Leeg in de config: de host van base_url.
221func (c Config) SSHPublicHost() string {
222 if h := strings.TrimSpace(c.SSH.PublicHost); h != "" {
223 return h
224 }
225 u, err := url.Parse(c.BaseURL)
226 if err != nil {
227 return ""
228 }
229 return u.Hostname()
230}
231
232// SSHPublicPort is de poort in een SSH-clone-URL.
233// 0 in de config: de poort van ssh.listen.
234func (c Config) SSHPublicPort() int {
235 if c.SSH.PublicPort > 0 {
236 return c.SSH.PublicPort
237 }
238 _, port, err := net.SplitHostPort(c.SSH.Listen)
239 if err != nil {
240 return 22
241 }
242 n, err := strconv.Atoi(port)
243 if err != nil || n <= 0 {
244 return 22
245 }
246 return n
247}
248
249// CloneSSH is de URL die een gebruiker kloont. Leeg als SSH uit staat.
250func (c Config) CloneSSH(repoPath string) string {
251 if !c.SSH.Enabled {
252 return ""
253 }
254 host := c.SSHPublicHost()
255 if strings.Contains(host, ":") && !strings.HasPrefix(host, "[") {
256 host = "[" + host + "]"
257 }
258 return fmt.Sprintf("ssh://git@%s:%d/%s.git", host, c.SSHPublicPort(), repoPath)
259}
260
261// RedirectURI is de callback die bij de auth-server geregistreerd moet staan.
262func (c Config) RedirectURI() string {
263 return c.BaseURL + c.Auth.RedirectPath
264}
265
266// Example is een startconfiguratie voor de mini-PC.
267func Example() string {
268 return `# BlueGit op de mini-PC. Kopieer naar /etc/bluegit/config.yml.
269# Plain HTTP. TLS en de publieke SSH-poort doet de ingress, zie docs/INGRESS.md.
270base_url: https://git.timfalken.com
271listen: 0.0.0.0:8080
272# Database, sleutel en het gekozen opslagpad. Dit is niet de datadisk.
273state_path: /var/lib/bluegit
274# storage_path blijft leeg. De installatiebeheerder kiest de datadisk
275# bij de eerste aanmelding. Er is geen standaardpad.
276# Alleen deze adressen mogen X-Forwarded-For en X-Real-IP zetten.
277# Zet hier het IP van de ingress, zoals de mini-PC die verbinding ziet.
278trusted_proxies:
279 - 10.0.0.2
280
281auth:
282 mode: oauth
283 base_url: https://auth.timfalken.com
284 # Het domein is de client_id. Registreer het pad /auth/callback bij /admin.
285 client_id: git.timfalken.com
286 # Laat leeg en zet BLUEGIT_AUTH_CLIENT_SECRET, of gebruik client_secret_file.
287 client_secret: ""
288 client_secret_file: /etc/bluegit/client_secret
289 redirect_path: /auth/callback
290 user_agent: BlueGitAccountClient/0.1
291
292git:
293 binary: git
294 default_branch: master
295
296ssh:
297 enabled: true
298 # Waar dit proces git-SSH aanneemt. De SSH van het besturingssysteem blijft vrij.
299 listen: 0.0.0.0:2222
300 # Wat gebruikers in de clone-URL zien. De ingress stuurt poort 22 hiernaartoe.
301 public_host: git.timfalken.com
302 public_port: 22
303
304ci:
305 enabled: true
306 docker_binary: docker
307 concurrency: 1
308 network: bridge
309 timeout_seconds: 1800
310`
311}
internal/config/config_test.go added +139 −0
@@ -0,0 +1,139 @@
1 package config
2
3 import (
4 "os"
5 "path/filepath"
6 "strings"
7 "testing"
8 )
9
10 func TestStoragePathOptional(t *testing.T) {
11 dir := t.TempDir()
12 path := filepath.Join(dir, "config.yml")
13 body := []byte("base_url: https://git.example.test\nauth:\n mode: oauth\n client_id: git.example.test\n")
14 if err := os.WriteFile(path, body, 0o600); err != nil {
15 t.Fatal(err)
16 }
17 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
18 cfg, err := Load(path)
19 if err != nil {
20 t.Fatal(err)
21 }
22 if cfg.StoragePath != "" {
23 t.Fatalf("geen standaardpad verwacht, kreeg %q", cfg.StoragePath)
24 }
25 if cfg.StatePath != "/var/lib/bluegit" {
26 t.Fatal(cfg.StatePath)
27 }
28 if strings.Contains(Example(), "/mnt/storage") {
29 t.Fatal("voorbeeldconfiguratie bevat nog een vast schijfpad")
30 }
31 }
32
33 func TestDevModeRefusedOnProductionHost(t *testing.T) {
34 dir := t.TempDir()
35 path := filepath.Join(dir, "config.yml")
36 body := []byte("base_url: https://git.timfalken.com\nstorage_path: /mnt/storage/bluegit\nauth:\n mode: dev\n")
37 if err := os.WriteFile(path, body, 0o600); err != nil {
38 t.Fatal(err)
39 }
40 _, err := Load(path)
41 if err == nil || !strings.Contains(err.Error(), "dev") {
42 t.Fatalf("verwacht weigering, kreeg %v", err)
43 }
44 }
45
46 func TestSecretFromEnv(t *testing.T) {
47 dir := t.TempDir()
48 path := filepath.Join(dir, "config.yml")
49 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nauth:\n mode: oauth\n client_id: git.example.test\n")
50 if err := os.WriteFile(path, body, 0o600); err != nil {
51 t.Fatal(err)
52 }
53 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "uit-de-omgeving")
54 cfg, err := Load(path)
55 if err != nil {
56 t.Fatal(err)
57 }
58 if cfg.Auth.ClientSecret != "uit-de-omgeving" || cfg.Git.DefaultBranch != "master" {
59 t.Fatalf("branch %s geheim %s", cfg.Git.DefaultBranch, cfg.Auth.ClientSecret)
60 }
61 if cfg.RedirectURI() != "https://git.example.test/auth/callback" {
62 t.Fatal(cfg.RedirectURI())
63 }
64 if cfg.SSHPublicHost() != "git.example.test" || cfg.SSHPublicPort() != 2222 {
65 t.Fatalf("ssh %s:%d", cfg.SSHPublicHost(), cfg.SSHPublicPort())
66 }
67 if cfg.CloneSSH("tim/demo") != "" {
68 t.Fatal("ssh staat uit, dus geen clone-URL")
69 }
70 }
71
72 func TestPublicSSHAndTrustedProxy(t *testing.T) {
73 dir := t.TempDir()
74 path := filepath.Join(dir, "config.yml")
75 body := []byte(`base_url: https://git.timfalken.com
76 storage_path: ` + dir + `
77 listen: 0.0.0.0:8080
78 trusted_proxies: ["10.0.0.2", "192.168.0.0/16"]
79 auth:
80 mode: oauth
81 client_id: git.timfalken.com
82 ssh:
83 enabled: true
84 listen: 0.0.0.0:2222
85 public_host: git.timfalken.com
86 public_port: 22
87 `)
88 if err := os.WriteFile(path, body, 0o600); err != nil {
89 t.Fatal(err)
90 }
91 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
92 cfg, err := Load(path)
93 if err != nil {
94 t.Fatal(err)
95 }
96 if cfg.CloneSSH("tim/demo") != "ssh://git@git.timfalken.com:22/tim/demo.git" {
97 t.Fatal(cfg.CloneSSH("tim/demo"))
98 }
99 if cfg.ProxySet() == nil || cfg.Listen != "0.0.0.0:8080" {
100 t.Fatalf("%+v", cfg)
101 }
102 }
103
104 func TestBehindProxyFlagRejected(t *testing.T) {
105 dir := t.TempDir()
106 path := filepath.Join(dir, "config.yml")
107 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nbehind_proxy: true\nauth:\n mode: oauth\n client_id: git.example.test\n")
108 if err := os.WriteFile(path, body, 0o600); err != nil {
109 t.Fatal(err)
110 }
111 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
112 _, err := Load(path)
113 if err == nil || !strings.Contains(err.Error(), "trusted_proxies") {
114 t.Fatalf("verwacht weigering van behind_proxy, kreeg %v", err)
115 }
116 }
117
118 func TestBadProxyRejected(t *testing.T) {
119 dir := t.TempDir()
120 path := filepath.Join(dir, "config.yml")
121 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\ntrusted_proxies: [ingress.local]\nauth:\n mode: oauth\n client_id: git.example.test\n")
122 if err := os.WriteFile(path, body, 0o600); err != nil {
123 t.Fatal(err)
124 }
125 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
126 _, err := Load(path)
127 if err == nil || !strings.Contains(err.Error(), "trusted_proxies") {
128 t.Fatalf("verwacht weigering, kreeg %v", err)
129 }
130 body = []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nauth:\n mode: oauth\n client_id: git.example.test\nssh:\n enabled: true\n public_host: git.example.test:22\n")
131 path = filepath.Join(dir, "port.yml")
132 if err := os.WriteFile(path, body, 0o600); err != nil {
133 t.Fatal(err)
134 }
135 _, err = Load(path)
136 if err == nil || !strings.Contains(err.Error(), "public_host") {
137 t.Fatalf("verwacht weigering van een poort in de host, kreeg %v", err)
138 }
139 }
@@ -0,0 +1,139 @@
1package config
2
3import (
4 "os"
5 "path/filepath"
6 "strings"
7 "testing"
8)
9
10func TestStoragePathOptional(t *testing.T) {
11 dir := t.TempDir()
12 path := filepath.Join(dir, "config.yml")
13 body := []byte("base_url: https://git.example.test\nauth:\n mode: oauth\n client_id: git.example.test\n")
14 if err := os.WriteFile(path, body, 0o600); err != nil {
15 t.Fatal(err)
16 }
17 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
18 cfg, err := Load(path)
19 if err != nil {
20 t.Fatal(err)
21 }
22 if cfg.StoragePath != "" {
23 t.Fatalf("geen standaardpad verwacht, kreeg %q", cfg.StoragePath)
24 }
25 if cfg.StatePath != "/var/lib/bluegit" {
26 t.Fatal(cfg.StatePath)
27 }
28 if strings.Contains(Example(), "/mnt/storage") {
29 t.Fatal("voorbeeldconfiguratie bevat nog een vast schijfpad")
30 }
31}
32
33func TestDevModeRefusedOnProductionHost(t *testing.T) {
34 dir := t.TempDir()
35 path := filepath.Join(dir, "config.yml")
36 body := []byte("base_url: https://git.timfalken.com\nstorage_path: /mnt/storage/bluegit\nauth:\n mode: dev\n")
37 if err := os.WriteFile(path, body, 0o600); err != nil {
38 t.Fatal(err)
39 }
40 _, err := Load(path)
41 if err == nil || !strings.Contains(err.Error(), "dev") {
42 t.Fatalf("verwacht weigering, kreeg %v", err)
43 }
44}
45
46func TestSecretFromEnv(t *testing.T) {
47 dir := t.TempDir()
48 path := filepath.Join(dir, "config.yml")
49 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nauth:\n mode: oauth\n client_id: git.example.test\n")
50 if err := os.WriteFile(path, body, 0o600); err != nil {
51 t.Fatal(err)
52 }
53 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "uit-de-omgeving")
54 cfg, err := Load(path)
55 if err != nil {
56 t.Fatal(err)
57 }
58 if cfg.Auth.ClientSecret != "uit-de-omgeving" || cfg.Git.DefaultBranch != "master" {
59 t.Fatalf("branch %s geheim %s", cfg.Git.DefaultBranch, cfg.Auth.ClientSecret)
60 }
61 if cfg.RedirectURI() != "https://git.example.test/auth/callback" {
62 t.Fatal(cfg.RedirectURI())
63 }
64 if cfg.SSHPublicHost() != "git.example.test" || cfg.SSHPublicPort() != 2222 {
65 t.Fatalf("ssh %s:%d", cfg.SSHPublicHost(), cfg.SSHPublicPort())
66 }
67 if cfg.CloneSSH("tim/demo") != "" {
68 t.Fatal("ssh staat uit, dus geen clone-URL")
69 }
70}
71
72func TestPublicSSHAndTrustedProxy(t *testing.T) {
73 dir := t.TempDir()
74 path := filepath.Join(dir, "config.yml")
75 body := []byte(`base_url: https://git.timfalken.com
76storage_path: ` + dir + `
77listen: 0.0.0.0:8080
78trusted_proxies: ["10.0.0.2", "192.168.0.0/16"]
79auth:
80 mode: oauth
81 client_id: git.timfalken.com
82ssh:
83 enabled: true
84 listen: 0.0.0.0:2222
85 public_host: git.timfalken.com
86 public_port: 22
87`)
88 if err := os.WriteFile(path, body, 0o600); err != nil {
89 t.Fatal(err)
90 }
91 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
92 cfg, err := Load(path)
93 if err != nil {
94 t.Fatal(err)
95 }
96 if cfg.CloneSSH("tim/demo") != "ssh://git@git.timfalken.com:22/tim/demo.git" {
97 t.Fatal(cfg.CloneSSH("tim/demo"))
98 }
99 if cfg.ProxySet() == nil || cfg.Listen != "0.0.0.0:8080" {
100 t.Fatalf("%+v", cfg)
101 }
102}
103
104func TestBehindProxyFlagRejected(t *testing.T) {
105 dir := t.TempDir()
106 path := filepath.Join(dir, "config.yml")
107 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nbehind_proxy: true\nauth:\n mode: oauth\n client_id: git.example.test\n")
108 if err := os.WriteFile(path, body, 0o600); err != nil {
109 t.Fatal(err)
110 }
111 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
112 _, err := Load(path)
113 if err == nil || !strings.Contains(err.Error(), "trusted_proxies") {
114 t.Fatalf("verwacht weigering van behind_proxy, kreeg %v", err)
115 }
116}
117
118func TestBadProxyRejected(t *testing.T) {
119 dir := t.TempDir()
120 path := filepath.Join(dir, "config.yml")
121 body := []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\ntrusted_proxies: [ingress.local]\nauth:\n mode: oauth\n client_id: git.example.test\n")
122 if err := os.WriteFile(path, body, 0o600); err != nil {
123 t.Fatal(err)
124 }
125 t.Setenv("BLUEGIT_AUTH_CLIENT_SECRET", "geheim")
126 _, err := Load(path)
127 if err == nil || !strings.Contains(err.Error(), "trusted_proxies") {
128 t.Fatalf("verwacht weigering, kreeg %v", err)
129 }
130 body = []byte("base_url: https://git.example.test\nstorage_path: " + dir + "\nauth:\n mode: oauth\n client_id: git.example.test\nssh:\n enabled: true\n public_host: git.example.test:22\n")
131 path = filepath.Join(dir, "port.yml")
132 if err := os.WriteFile(path, body, 0o600); err != nil {
133 t.Fatal(err)
134 }
135 _, err = Load(path)
136 if err == nil || !strings.Contains(err.Error(), "public_host") {
137 t.Fatalf("verwacht weigering van een poort in de host, kreeg %v", err)
138 }
139}
internal/gitrepo/http.go added +90 −0
@@ -0,0 +1,90 @@
1 package gitrepo
2
3 import (
4 "bufio"
5 "fmt"
6 "io"
7 "net/http"
8 "os"
9 "os/exec"
10 "strconv"
11 "strings"
12 )
13
14 // ServeSmartHTTP voert git http-backend uit voor één repository.
15 // pathInfo is het PATH_INFO vanaf de repository, bijvoorbeeld
16 // /tim/bluegit.git/info/refs. extraEnv gaat naar het kindproces en
17 // daarmee naar de pre-receive-hook.
18 func ServeSmartHTTP(w http.ResponseWriter, r *http.Request, gitBin, projectRoot, pathInfo string, extraEnv []string) error {
19 if gitBin == "" {
20 gitBin = "git"
21 }
22 cmd := exec.CommandContext(r.Context(), gitBin, "http-backend")
23 cmd.Env = append(os.Environ(),
24 "GIT_PROJECT_ROOT="+projectRoot,
25 "GIT_HTTP_EXPORT_ALL=1",
26 "PATH_INFO="+pathInfo,
27 "REQUEST_METHOD="+r.Method,
28 "QUERY_STRING="+r.URL.RawQuery,
29 "CONTENT_TYPE="+r.Header.Get("Content-Type"),
30 "REMOTE_ADDR="+r.RemoteAddr,
31 )
32 if r.ContentLength >= 0 {
33 cmd.Env = append(cmd.Env, "CONTENT_LENGTH="+strconv.FormatInt(r.ContentLength, 10))
34 }
35 cmd.Env = append(cmd.Env, extraEnv...)
36 cmd.Stdin = r.Body
37 stdout, err := cmd.StdoutPipe()
38 if err != nil {
39 return err
40 }
41 var stderr strings.Builder
42 cmd.Stderr = &stderr
43 if err := cmd.Start(); err != nil {
44 return err
45 }
46 br := bufio.NewReader(stdout)
47 status := 200
48 for {
49 line, err := br.ReadString('\n')
50 if err != nil {
51 _ = cmd.Wait()
52 return fmt.Errorf("git http-backend: %v (%s)", err, strings.TrimSpace(stderr.String()))
53 }
54 line = strings.TrimRight(line, "\r\n")
55 if line == "" {
56 break
57 }
58 name, value, ok := strings.Cut(line, ":")
59 if !ok {
60 continue
61 }
62 name = strings.TrimSpace(name)
63 value = strings.TrimSpace(value)
64 if strings.EqualFold(name, "Status") {
65 fmt.Sscanf(value, "%d", &status)
66 continue
67 }
68 w.Header().Add(name, value)
69 }
70 w.WriteHeader(status)
71 _, _ = io.Copy(w, br)
72 if err := cmd.Wait(); err != nil {
73 return fmt.Errorf("git http-backend: %v (%s)", err, strings.TrimSpace(stderr.String()))
74 }
75 return nil
76 }
77
78 // ProjectRoot is de map waarin owner/naam.git staat.
79 func ProjectRoot(storage string) string {
80 return storage + "/repos"
81 }
82
83 // PathInfo bouwt het CGI-pad.
84 func PathInfo(owner, repoWithGit, rest string) string {
85 p := "/" + owner + "/" + repoWithGit
86 if rest != "" {
87 p += "/" + strings.TrimPrefix(rest, "/")
88 }
89 return p
90 }
@@ -0,0 +1,90 @@
1package gitrepo
2
3import (
4 "bufio"
5 "fmt"
6 "io"
7 "net/http"
8 "os"
9 "os/exec"
10 "strconv"
11 "strings"
12)
13
14// ServeSmartHTTP voert git http-backend uit voor één repository.
15// pathInfo is het PATH_INFO vanaf de repository, bijvoorbeeld
16// /tim/bluegit.git/info/refs. extraEnv gaat naar het kindproces en
17// daarmee naar de pre-receive-hook.
18func ServeSmartHTTP(w http.ResponseWriter, r *http.Request, gitBin, projectRoot, pathInfo string, extraEnv []string) error {
19 if gitBin == "" {
20 gitBin = "git"
21 }
22 cmd := exec.CommandContext(r.Context(), gitBin, "http-backend")
23 cmd.Env = append(os.Environ(),
24 "GIT_PROJECT_ROOT="+projectRoot,
25 "GIT_HTTP_EXPORT_ALL=1",
26 "PATH_INFO="+pathInfo,
27 "REQUEST_METHOD="+r.Method,
28 "QUERY_STRING="+r.URL.RawQuery,
29 "CONTENT_TYPE="+r.Header.Get("Content-Type"),
30 "REMOTE_ADDR="+r.RemoteAddr,
31 )
32 if r.ContentLength >= 0 {
33 cmd.Env = append(cmd.Env, "CONTENT_LENGTH="+strconv.FormatInt(r.ContentLength, 10))
34 }
35 cmd.Env = append(cmd.Env, extraEnv...)
36 cmd.Stdin = r.Body
37 stdout, err := cmd.StdoutPipe()
38 if err != nil {
39 return err
40 }
41 var stderr strings.Builder
42 cmd.Stderr = &stderr
43 if err := cmd.Start(); err != nil {
44 return err
45 }
46 br := bufio.NewReader(stdout)
47 status := 200
48 for {
49 line, err := br.ReadString('\n')
50 if err != nil {
51 _ = cmd.Wait()
52 return fmt.Errorf("git http-backend: %v (%s)", err, strings.TrimSpace(stderr.String()))
53 }
54 line = strings.TrimRight(line, "\r\n")
55 if line == "" {
56 break
57 }
58 name, value, ok := strings.Cut(line, ":")
59 if !ok {
60 continue
61 }
62 name = strings.TrimSpace(name)
63 value = strings.TrimSpace(value)
64 if strings.EqualFold(name, "Status") {
65 fmt.Sscanf(value, "%d", &status)
66 continue
67 }
68 w.Header().Add(name, value)
69 }
70 w.WriteHeader(status)
71 _, _ = io.Copy(w, br)
72 if err := cmd.Wait(); err != nil {
73 return fmt.Errorf("git http-backend: %v (%s)", err, strings.TrimSpace(stderr.String()))
74 }
75 return nil
76}
77
78// ProjectRoot is de map waarin owner/naam.git staat.
79func ProjectRoot(storage string) string {
80 return storage + "/repos"
81}
82
83// PathInfo bouwt het CGI-pad.
84func PathInfo(owner, repoWithGit, rest string) string {
85 p := "/" + owner + "/" + repoWithGit
86 if rest != "" {
87 p += "/" + strings.TrimPrefix(rest, "/")
88 }
89 return p
90}
internal/gitrepo/repo.go added +326 −0
@@ -0,0 +1,326 @@
1 // Package gitrepo legt bare repositories op schijf en praat met de git-binary.
2 package gitrepo
3
4 import (
5 "bufio"
6 "bytes"
7 "context"
8 "fmt"
9 "io"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14
15 "gitlab.com/Timfa/bluegit/internal/access"
16 )
17
18 // Dir is de bare repository op de datadisk.
19 func Dir(storage, owner, name string) string {
20 return filepath.Join(storage, "repos", owner, name+".git")
21 }
22
23 // Init maakt een lege bare repository en zet de pre-receive-hook.
24 func Init(gitBin, dir, defaultBranch, hookBinary string) error {
25 if err := os.MkdirAll(filepath.Dir(dir), 0o755); err != nil {
26 return err
27 }
28 if _, err := run(context.Background(), gitBin, nil, "init", "--bare", "--initial-branch", defaultBranch, dir); err != nil {
29 return err
30 }
31 for _, kv := range [][2]string{
32 {"http.receivepack", "true"},
33 {"http.uploadpack", "true"},
34 {"receive.denyCurrentBranch", "ignore"},
35 } {
36 if _, err := run(context.Background(), gitBin, nil, "-C", dir, "config", kv[0], kv[1]); err != nil {
37 return err
38 }
39 }
40 return InstallHook(dir, hookBinary)
41 }
42
43 // InstallHook schrijft hooks/pre-receive. Die roept deze binary aan.
44 func InstallHook(dir, hookBinary string) error {
45 if hookBinary == "" {
46 return fmt.Errorf("hook-binary ontbreekt")
47 }
48 path := filepath.Join(dir, "hooks", "pre-receive")
49 body := "#!/bin/sh\nset -eu\nexec " + shellQuote(hookBinary) + " hook pre-receive\n"
50 if err := os.WriteFile(path, []byte(body), 0o755); err != nil {
51 return err
52 }
53 return nil
54 }
55
56 func shellQuote(s string) string {
57 return "'" + strings.ReplaceAll(s, "'", `'\''`) + "'"
58 }
59
60 // PushEnv zijn de variabelen die de hook leest. Zonder deze variabelen
61 // weigert de hook, zodat een push buiten BlueGit om niet slaagt.
62 func PushEnv(role access.Role, patterns []string) []string {
63 return []string{
64 "BLUEGIT_ROLE=" + string(role),
65 "BLUEGIT_PROTECTED=" + strings.Join(patterns, "\n"),
66 }
67 }
68
69 // ReadUpdates leest de regels van een pre-receive-hook.
70 func ReadUpdates(r io.Reader) ([]access.RefUpdate, error) {
71 sc := bufio.NewScanner(r)
72 var out []access.RefUpdate
73 for sc.Scan() {
74 line := strings.TrimSpace(sc.Text())
75 if line == "" {
76 continue
77 }
78 parts := strings.Fields(line)
79 if len(parts) != 3 {
80 return nil, fmt.Errorf("onverwachte hookregel %q", line)
81 }
82 out = append(out, access.RefUpdate{Old: parts[0], New: parts[1], Ref: parts[2]})
83 }
84 return out, sc.Err()
85 }
86
87 // EvaluatePush is wat `bluegit hook pre-receive` doet.
88 func EvaluatePush(role access.Role, patterns []string, r io.Reader) error {
89 if role == "" {
90 return fmt.Errorf("push geweigerd: geen BlueGit-rol")
91 }
92 ups, err := ReadUpdates(r)
93 if err != nil {
94 return err
95 }
96 return access.AuthorizeUpdates(role, patterns, ups)
97 }
98
99 // Commit is één commit voor de webinterface.
100 type Commit struct {
101 SHA string
102 Short string
103 Author string
104 Date string
105 Subject string
106 Body string
107 }
108
109 // Entry is een bestand of map in een tree.
110 type Entry struct {
111 Mode string
112 Type string
113 SHA string
114 Name string
115 }
116
117 // Log geeft de nieuwste commits.
118 func Log(ctx context.Context, gitBin, dir, rev string, limit int) ([]Commit, error) {
119 if rev == "" {
120 rev = "HEAD"
121 }
122 out, err := run(ctx, gitBin, nil, "-C", dir, "log", "--format=%H%x1f%an%x1f%ad%x1f%s%x1f%b%x1e", "--date=short", fmt.Sprintf("-n%d", limit), rev)
123 if err != nil {
124 if strings.Contains(err.Error(), "does not have any commits") || strings.Contains(err.Error(), "bad default revision") || strings.Contains(err.Error(), "ambiguous argument") {
125 return nil, nil
126 }
127 return nil, err
128 }
129 return parseLog(out), nil
130 }
131
132 func parseLog(out string) []Commit {
133 var commits []Commit
134 for _, rec := range strings.Split(out, "\x1e") {
135 rec = strings.TrimSpace(rec)
136 if rec == "" {
137 continue
138 }
139 parts := strings.Split(rec, "\x1f")
140 if len(parts) < 4 {
141 continue
142 }
143 c := Commit{SHA: parts[0], Author: parts[1], Date: parts[2], Subject: parts[3]}
144 if len(c.SHA) >= 10 {
145 c.Short = c.SHA[:10]
146 }
147 if len(parts) > 4 {
148 c.Body = strings.TrimSpace(parts[4])
149 }
150 commits = append(commits, c)
151 }
152 return commits
153 }
154
155 // Show leest één commit.
156 func Show(ctx context.Context, gitBin, dir, sha string) (Commit, error) {
157 list, err := Log(ctx, gitBin, dir, sha, 1)
158 if err != nil {
159 return Commit{}, err
160 }
161 if len(list) == 0 {
162 return Commit{}, fmt.Errorf("commit niet gevonden")
163 }
164 return list[0], nil
165 }
166
167 // Tree leest een map. path is relatief en mag leeg zijn.
168 func Tree(ctx context.Context, gitBin, dir, rev, rel string) ([]Entry, error) {
169 spec := rev
170 if rel != "" {
171 spec = rev + ":" + rel
172 }
173 out, err := run(ctx, gitBin, nil, "-C", dir, "ls-tree", spec)
174 if err != nil {
175 return nil, err
176 }
177 var entries []Entry
178 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
179 if line == "" {
180 continue
181 }
182 // mode type sha\tname
183 tab := strings.SplitN(line, "\t", 2)
184 if len(tab) != 2 {
185 continue
186 }
187 head := strings.Fields(tab[0])
188 if len(head) != 3 {
189 continue
190 }
191 entries = append(entries, Entry{Mode: head[0], Type: head[1], SHA: head[2], Name: tab[1]})
192 }
193 return entries, nil
194 }
195
196 // Blob leest een tekstbestand, afgekapt op max bytes. binary is waar als
197 // het bestand een NUL bevat.
198 func Blob(ctx context.Context, gitBin, dir, rev, rel string, max int) (text string, binary bool, err error) {
199 out, err := run(ctx, gitBin, nil, "-C", dir, "show", rev+":"+rel)
200 if err != nil {
201 return "", false, err
202 }
203 if strings.Contains(out, "\x00") {
204 return "", true, nil
205 }
206 if len(out) > max {
207 out = out[:max] + "\n… afgekapt"
208 }
209 return out, false, nil
210 }
211
212 // Branches geeft lokale branchnamen.
213 func Branches(ctx context.Context, gitBin, dir string) ([]string, error) {
214 out, err := run(ctx, gitBin, nil, "-C", dir, "for-each-ref", "--format=%(refname:short)", "refs/heads")
215 if err != nil {
216 return nil, err
217 }
218 var names []string
219 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
220 if line != "" {
221 names = append(names, line)
222 }
223 }
224 return names, nil
225 }
226
227 // HasCommit meldt of sha een commit in deze repository is.
228 func HasCommit(ctx context.Context, gitBin, dir, sha string) bool {
229 out, err := run(ctx, gitBin, nil, "-C", dir, "cat-file", "-t", sha)
230 return err == nil && strings.TrimSpace(out) == "commit"
231 }
232
233 // Refs geeft refnaam → sha.
234 func Refs(ctx context.Context, gitBin, dir string) (map[string]string, error) {
235 out, err := run(ctx, gitBin, nil, "-C", dir, "for-each-ref", "--format=%(objectname) %(refname)")
236 if err != nil {
237 return nil, err
238 }
239 m := map[string]string{}
240 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
241 if line == "" {
242 continue
243 }
244 parts := strings.SplitN(line, " ", 2)
245 if len(parts) == 2 {
246 m[parts[1]] = parts[0]
247 }
248 }
249 return m, nil
250 }
251
252 // BranchOfRef haalt de branch uit refs/heads/… .
253 func BranchOfRef(ref string) (string, bool) {
254 const p = "refs/heads/"
255 if strings.HasPrefix(ref, p) && len(ref) > len(p) {
256 return ref[len(p):], true
257 }
258 return "", false
259 }
260
261 // Merge voegt source samen in target en pusht het resultaat.
262 // De push gaat door de hook, dus role en patterns moeten kloppen.
263 func Merge(ctx context.Context, gitBin, bare, work, source, target, author, email, message string, role access.Role, patterns []string) error {
264 if err := os.RemoveAll(work); err != nil {
265 return err
266 }
267 if err := os.MkdirAll(filepath.Dir(work), 0o755); err != nil {
268 return err
269 }
270 if _, err := run(ctx, gitBin, nil, "clone", bare, work); err != nil {
271 return err
272 }
273 env := append(os.Environ(),
274 "GIT_AUTHOR_NAME="+author,
275 "GIT_AUTHOR_EMAIL="+email,
276 "GIT_COMMITTER_NAME="+author,
277 "GIT_COMMITTER_EMAIL="+email,
278 )
279 if _, err := run(ctx, gitBin, env, "-C", work, "checkout", target); err != nil {
280 return fmt.Errorf("doelbranch %s: %w", target, err)
281 }
282 if _, err := run(ctx, gitBin, env, "-C", work, "merge", "--no-ff", "--no-edit", "-m", message, source); err != nil {
283 return fmt.Errorf("samenvoegen lukt niet, er is een conflict of de branch ontbreekt")
284 }
285 pushEnv := append(env, PushEnv(role, patterns)...)
286 if _, err := run(ctx, gitBin, pushEnv, "-C", work, "push", "origin", target); err != nil {
287 return err
288 }
289 return nil
290 }
291
292 // Tag zet een annotated tag op sha.
293 func Tag(ctx context.Context, gitBin, dir, tag, sha, message string) error {
294 _, err := run(ctx, gitBin, nil, "-C", dir, "tag", "-a", tag, sha, "-m", message)
295 return err
296 }
297
298 // DiffStat is een korte vergelijking tussen twee branches.
299 func DiffStat(ctx context.Context, gitBin, dir, target, source string) (string, error) {
300 out, err := run(ctx, gitBin, nil, "-C", dir, "log", "--oneline", target+".."+source)
301 if err != nil {
302 return "", err
303 }
304 return strings.TrimSpace(out), nil
305 }
306
307 func run(ctx context.Context, bin string, env []string, args ...string) (string, error) {
308 if bin == "" {
309 bin = "git"
310 }
311 cmd := exec.CommandContext(ctx, bin, args...)
312 if env != nil {
313 cmd.Env = env
314 }
315 var stdout, stderr bytes.Buffer
316 cmd.Stdout = &stdout
317 cmd.Stderr = &stderr
318 if err := cmd.Run(); err != nil {
319 msg := strings.TrimSpace(stderr.String())
320 if msg == "" {
321 msg = err.Error()
322 }
323 return "", fmt.Errorf("%s", msg)
324 }
325 return stdout.String(), nil
326 }
@@ -0,0 +1,326 @@
1// Package gitrepo legt bare repositories op schijf en praat met de git-binary.
2package gitrepo
3
4import (
5 "bufio"
6 "bytes"
7 "context"
8 "fmt"
9 "io"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14
15 "gitlab.com/Timfa/bluegit/internal/access"
16)
17
18// Dir is de bare repository op de datadisk.
19func Dir(storage, owner, name string) string {
20 return filepath.Join(storage, "repos", owner, name+".git")
21}
22
23// Init maakt een lege bare repository en zet de pre-receive-hook.
24func Init(gitBin, dir, defaultBranch, hookBinary string) error {
25 if err := os.MkdirAll(filepath.Dir(dir), 0o755); err != nil {
26 return err
27 }
28 if _, err := run(context.Background(), gitBin, nil, "init", "--bare", "--initial-branch", defaultBranch, dir); err != nil {
29 return err
30 }
31 for _, kv := range [][2]string{
32 {"http.receivepack", "true"},
33 {"http.uploadpack", "true"},
34 {"receive.denyCurrentBranch", "ignore"},
35 } {
36 if _, err := run(context.Background(), gitBin, nil, "-C", dir, "config", kv[0], kv[1]); err != nil {
37 return err
38 }
39 }
40 return InstallHook(dir, hookBinary)
41}
42
43// InstallHook schrijft hooks/pre-receive. Die roept deze binary aan.
44func InstallHook(dir, hookBinary string) error {
45 if hookBinary == "" {
46 return fmt.Errorf("hook-binary ontbreekt")
47 }
48 path := filepath.Join(dir, "hooks", "pre-receive")
49 body := "#!/bin/sh\nset -eu\nexec " + shellQuote(hookBinary) + " hook pre-receive\n"
50 if err := os.WriteFile(path, []byte(body), 0o755); err != nil {
51 return err
52 }
53 return nil
54}
55
56func shellQuote(s string) string {
57 return "'" + strings.ReplaceAll(s, "'", `'\''`) + "'"
58}
59
60// PushEnv zijn de variabelen die de hook leest. Zonder deze variabelen
61// weigert de hook, zodat een push buiten BlueGit om niet slaagt.
62func PushEnv(role access.Role, patterns []string) []string {
63 return []string{
64 "BLUEGIT_ROLE=" + string(role),
65 "BLUEGIT_PROTECTED=" + strings.Join(patterns, "\n"),
66 }
67}
68
69// ReadUpdates leest de regels van een pre-receive-hook.
70func ReadUpdates(r io.Reader) ([]access.RefUpdate, error) {
71 sc := bufio.NewScanner(r)
72 var out []access.RefUpdate
73 for sc.Scan() {
74 line := strings.TrimSpace(sc.Text())
75 if line == "" {
76 continue
77 }
78 parts := strings.Fields(line)
79 if len(parts) != 3 {
80 return nil, fmt.Errorf("onverwachte hookregel %q", line)
81 }
82 out = append(out, access.RefUpdate{Old: parts[0], New: parts[1], Ref: parts[2]})
83 }
84 return out, sc.Err()
85}
86
87// EvaluatePush is wat `bluegit hook pre-receive` doet.
88func EvaluatePush(role access.Role, patterns []string, r io.Reader) error {
89 if role == "" {
90 return fmt.Errorf("push geweigerd: geen BlueGit-rol")
91 }
92 ups, err := ReadUpdates(r)
93 if err != nil {
94 return err
95 }
96 return access.AuthorizeUpdates(role, patterns, ups)
97}
98
99// Commit is één commit voor de webinterface.
100type Commit struct {
101 SHA string
102 Short string
103 Author string
104 Date string
105 Subject string
106 Body string
107}
108
109// Entry is een bestand of map in een tree.
110type Entry struct {
111 Mode string
112 Type string
113 SHA string
114 Name string
115}
116
117// Log geeft de nieuwste commits.
118func Log(ctx context.Context, gitBin, dir, rev string, limit int) ([]Commit, error) {
119 if rev == "" {
120 rev = "HEAD"
121 }
122 out, err := run(ctx, gitBin, nil, "-C", dir, "log", "--format=%H%x1f%an%x1f%ad%x1f%s%x1f%b%x1e", "--date=short", fmt.Sprintf("-n%d", limit), rev)
123 if err != nil {
124 if strings.Contains(err.Error(), "does not have any commits") || strings.Contains(err.Error(), "bad default revision") || strings.Contains(err.Error(), "ambiguous argument") {
125 return nil, nil
126 }
127 return nil, err
128 }
129 return parseLog(out), nil
130}
131
132func parseLog(out string) []Commit {
133 var commits []Commit
134 for _, rec := range strings.Split(out, "\x1e") {
135 rec = strings.TrimSpace(rec)
136 if rec == "" {
137 continue
138 }
139 parts := strings.Split(rec, "\x1f")
140 if len(parts) < 4 {
141 continue
142 }
143 c := Commit{SHA: parts[0], Author: parts[1], Date: parts[2], Subject: parts[3]}
144 if len(c.SHA) >= 10 {
145 c.Short = c.SHA[:10]
146 }
147 if len(parts) > 4 {
148 c.Body = strings.TrimSpace(parts[4])
149 }
150 commits = append(commits, c)
151 }
152 return commits
153}
154
155// Show leest één commit.
156func Show(ctx context.Context, gitBin, dir, sha string) (Commit, error) {
157 list, err := Log(ctx, gitBin, dir, sha, 1)
158 if err != nil {
159 return Commit{}, err
160 }
161 if len(list) == 0 {
162 return Commit{}, fmt.Errorf("commit niet gevonden")
163 }
164 return list[0], nil
165}
166
167// Tree leest een map. path is relatief en mag leeg zijn.
168func Tree(ctx context.Context, gitBin, dir, rev, rel string) ([]Entry, error) {
169 spec := rev
170 if rel != "" {
171 spec = rev + ":" + rel
172 }
173 out, err := run(ctx, gitBin, nil, "-C", dir, "ls-tree", spec)
174 if err != nil {
175 return nil, err
176 }
177 var entries []Entry
178 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
179 if line == "" {
180 continue
181 }
182 // mode type sha\tname
183 tab := strings.SplitN(line, "\t", 2)
184 if len(tab) != 2 {
185 continue
186 }
187 head := strings.Fields(tab[0])
188 if len(head) != 3 {
189 continue
190 }
191 entries = append(entries, Entry{Mode: head[0], Type: head[1], SHA: head[2], Name: tab[1]})
192 }
193 return entries, nil
194}
195
196// Blob leest een tekstbestand, afgekapt op max bytes. binary is waar als
197// het bestand een NUL bevat.
198func Blob(ctx context.Context, gitBin, dir, rev, rel string, max int) (text string, binary bool, err error) {
199 out, err := run(ctx, gitBin, nil, "-C", dir, "show", rev+":"+rel)
200 if err != nil {
201 return "", false, err
202 }
203 if strings.Contains(out, "\x00") {
204 return "", true, nil
205 }
206 if len(out) > max {
207 out = out[:max] + "\n… afgekapt"
208 }
209 return out, false, nil
210}
211
212// Branches geeft lokale branchnamen.
213func Branches(ctx context.Context, gitBin, dir string) ([]string, error) {
214 out, err := run(ctx, gitBin, nil, "-C", dir, "for-each-ref", "--format=%(refname:short)", "refs/heads")
215 if err != nil {
216 return nil, err
217 }
218 var names []string
219 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
220 if line != "" {
221 names = append(names, line)
222 }
223 }
224 return names, nil
225}
226
227// HasCommit meldt of sha een commit in deze repository is.
228func HasCommit(ctx context.Context, gitBin, dir, sha string) bool {
229 out, err := run(ctx, gitBin, nil, "-C", dir, "cat-file", "-t", sha)
230 return err == nil && strings.TrimSpace(out) == "commit"
231}
232
233// Refs geeft refnaam → sha.
234func Refs(ctx context.Context, gitBin, dir string) (map[string]string, error) {
235 out, err := run(ctx, gitBin, nil, "-C", dir, "for-each-ref", "--format=%(objectname) %(refname)")
236 if err != nil {
237 return nil, err
238 }
239 m := map[string]string{}
240 for _, line := range strings.Split(strings.TrimSpace(out), "\n") {
241 if line == "" {
242 continue
243 }
244 parts := strings.SplitN(line, " ", 2)
245 if len(parts) == 2 {
246 m[parts[1]] = parts[0]
247 }
248 }
249 return m, nil
250}
251
252// BranchOfRef haalt de branch uit refs/heads/… .
253func BranchOfRef(ref string) (string, bool) {
254 const p = "refs/heads/"
255 if strings.HasPrefix(ref, p) && len(ref) > len(p) {
256 return ref[len(p):], true
257 }
258 return "", false
259}
260
261// Merge voegt source samen in target en pusht het resultaat.
262// De push gaat door de hook, dus role en patterns moeten kloppen.
263func Merge(ctx context.Context, gitBin, bare, work, source, target, author, email, message string, role access.Role, patterns []string) error {
264 if err := os.RemoveAll(work); err != nil {
265 return err
266 }
267 if err := os.MkdirAll(filepath.Dir(work), 0o755); err != nil {
268 return err
269 }
270 if _, err := run(ctx, gitBin, nil, "clone", bare, work); err != nil {
271 return err
272 }
273 env := append(os.Environ(),
274 "GIT_AUTHOR_NAME="+author,
275 "GIT_AUTHOR_EMAIL="+email,
276 "GIT_COMMITTER_NAME="+author,
277 "GIT_COMMITTER_EMAIL="+email,
278 )
279 if _, err := run(ctx, gitBin, env, "-C", work, "checkout", target); err != nil {
280 return fmt.Errorf("doelbranch %s: %w", target, err)
281 }
282 if _, err := run(ctx, gitBin, env, "-C", work, "merge", "--no-ff", "--no-edit", "-m", message, source); err != nil {
283 return fmt.Errorf("samenvoegen lukt niet, er is een conflict of de branch ontbreekt")
284 }
285 pushEnv := append(env, PushEnv(role, patterns)...)
286 if _, err := run(ctx, gitBin, pushEnv, "-C", work, "push", "origin", target); err != nil {
287 return err
288 }
289 return nil
290}
291
292// Tag zet een annotated tag op sha.
293func Tag(ctx context.Context, gitBin, dir, tag, sha, message string) error {
294 _, err := run(ctx, gitBin, nil, "-C", dir, "tag", "-a", tag, sha, "-m", message)
295 return err
296}
297
298// DiffStat is een korte vergelijking tussen twee branches.
299func DiffStat(ctx context.Context, gitBin, dir, target, source string) (string, error) {
300 out, err := run(ctx, gitBin, nil, "-C", dir, "log", "--oneline", target+".."+source)
301 if err != nil {
302 return "", err
303 }
304 return strings.TrimSpace(out), nil
305}
306
307func run(ctx context.Context, bin string, env []string, args ...string) (string, error) {
308 if bin == "" {
309 bin = "git"
310 }
311 cmd := exec.CommandContext(ctx, bin, args...)
312 if env != nil {
313 cmd.Env = env
314 }
315 var stdout, stderr bytes.Buffer
316 cmd.Stdout = &stdout
317 cmd.Stderr = &stderr
318 if err := cmd.Run(); err != nil {
319 msg := strings.TrimSpace(stderr.String())
320 if msg == "" {
321 msg = err.Error()
322 }
323 return "", fmt.Errorf("%s", msg)
324 }
325 return stdout.String(), nil
326}
internal/gitrepo/repo_test.go added +45 −0
@@ -0,0 +1,45 @@
1 package gitrepo
2
3 import (
4 "bytes"
5 "os"
6 "path/filepath"
7 "strings"
8 "testing"
9
10 "gitlab.com/Timfa/bluegit/internal/access"
11 )
12
13 func TestEvaluatePush(t *testing.T) {
14 var buf bytes.Buffer
15 buf.WriteString("0000000000000000000000000000000000000000 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa refs/heads/main\n")
16 err := EvaluatePush(access.RoleDeveloper, []string{"main"}, &buf)
17 if err == nil {
18 t.Fatal("ontwikkelaar mag main niet")
19 }
20 buf.Reset()
21 buf.WriteString("0000000000000000000000000000000000000000 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa refs/heads/feature\n")
22 if err := EvaluatePush(access.RoleDeveloper, []string{"main"}, &buf); err != nil {
23 t.Fatal(err)
24 }
25 if err := EvaluatePush(access.RoleMaintainer, nil, strings.NewReader("")); err == nil {
26 t.Fatal("lege push")
27 }
28 }
29
30 func TestInitWritesHook(t *testing.T) {
31 if _, err := os.Stat("/usr/bin/git"); err != nil {
32 t.Skip("git ontbreekt")
33 }
34 dir := filepath.Join(t.TempDir(), "demo.git")
35 if err := Init("git", dir, "main", "/usr/bin/bluegit"); err != nil {
36 t.Fatal(err)
37 }
38 body, err := os.ReadFile(filepath.Join(dir, "hooks", "pre-receive"))
39 if err != nil {
40 t.Fatal(err)
41 }
42 if !strings.Contains(string(body), "hook pre-receive") || !strings.Contains(string(body), "/usr/bin/bluegit") {
43 t.Fatalf("hook: %s", body)
44 }
45 }
@@ -0,0 +1,45 @@
1package gitrepo
2
3import (
4 "bytes"
5 "os"
6 "path/filepath"
7 "strings"
8 "testing"
9
10 "gitlab.com/Timfa/bluegit/internal/access"
11)
12
13func TestEvaluatePush(t *testing.T) {
14 var buf bytes.Buffer
15 buf.WriteString("0000000000000000000000000000000000000000 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa refs/heads/main\n")
16 err := EvaluatePush(access.RoleDeveloper, []string{"main"}, &buf)
17 if err == nil {
18 t.Fatal("ontwikkelaar mag main niet")
19 }
20 buf.Reset()
21 buf.WriteString("0000000000000000000000000000000000000000 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa refs/heads/feature\n")
22 if err := EvaluatePush(access.RoleDeveloper, []string{"main"}, &buf); err != nil {
23 t.Fatal(err)
24 }
25 if err := EvaluatePush(access.RoleMaintainer, nil, strings.NewReader("")); err == nil {
26 t.Fatal("lege push")
27 }
28}
29
30func TestInitWritesHook(t *testing.T) {
31 if _, err := os.Stat("/usr/bin/git"); err != nil {
32 t.Skip("git ontbreekt")
33 }
34 dir := filepath.Join(t.TempDir(), "demo.git")
35 if err := Init("git", dir, "main", "/usr/bin/bluegit"); err != nil {
36 t.Fatal(err)
37 }
38 body, err := os.ReadFile(filepath.Join(dir, "hooks", "pre-receive"))
39 if err != nil {
40 t.Fatal(err)
41 }
42 if !strings.Contains(string(body), "hook pre-receive") || !strings.Contains(string(body), "/usr/bin/bluegit") {
43 t.Fatalf("hook: %s", body)
44 }
45}
internal/names/names.go added +60 −0
@@ -0,0 +1,60 @@
1 // Package names bevat de padregels voor gebruikers, groepen en repositories.
2 package names
3
4 import (
5 "fmt"
6 "regexp"
7 "strings"
8 )
9
10 // Reserved paths botsen met vaste routes van de webinterface.
11 var reserved = map[string]bool{
12 "admin": true, "api": true, "assets": true, "auth": true,
13 "explore": true, "groups": true, "healthz": true, "help": true,
14 "internal": true, "login": true, "logout": true, "new": true,
15 "settings": true, "static": true, "g": true,
16 }
17
18 var (
19 groupPath = regexp.MustCompile(`^[a-z][a-z0-9_-]{0,62}$`)
20 repoName = regexp.MustCompile(`^[a-zA-Z0-9][a-zA-Z0-9._-]{0,62}$`)
21 userName = regexp.MustCompile(`^[a-z0-9][a-z0-9_-]{0,62}$`)
22 )
23
24 // ValidUsername volgt de auth-server: kleine letters.
25 func ValidUsername(s string) error {
26 if !userName.MatchString(s) || reserved[s] {
27 return fmt.Errorf("gebruikersnaam %q is hier niet bruikbaar", s)
28 }
29 return nil
30 }
31
32 // ValidGroupPath is het pad van een groep in de URL.
33 func ValidGroupPath(s string) error {
34 if !groupPath.MatchString(s) || reserved[s] {
35 return fmt.Errorf("groepspad %q is niet bruikbaar", s)
36 }
37 return nil
38 }
39
40 // ValidRepoName is de repositorynaam zonder .git.
41 func ValidRepoName(s string) error {
42 if !repoName.MatchString(s) || strings.HasSuffix(strings.ToLower(s), ".git") || s == "." || s == ".." {
43 return fmt.Errorf("repositorynaam %q is niet bruikbaar", s)
44 }
45 return nil
46 }
47
48 // ValidTag beperkt release-tags tot een git-ref die niet ontsnapt.
49 func ValidTag(s string) error {
50 if s == "" || len(s) > 80 || strings.HasPrefix(s, "-") || strings.Contains(s, "..") {
51 return fmt.Errorf("tag %q is niet bruikbaar", s)
52 }
53 for _, c := range s {
54 ok := (c >= 'a' && c <= 'z') || (c >= 'A' && c <= 'Z') || (c >= '0' && c <= '9') || c == '.' || c == '_' || c == '-'
55 if !ok {
56 return fmt.Errorf("tag %q bevat een verboden teken", s)
57 }
58 }
59 return nil
60 }
@@ -0,0 +1,60 @@
1// Package names bevat de padregels voor gebruikers, groepen en repositories.
2package names
3
4import (
5 "fmt"
6 "regexp"
7 "strings"
8)
9
10// Reserved paths botsen met vaste routes van de webinterface.
11var reserved = map[string]bool{
12 "admin": true, "api": true, "assets": true, "auth": true,
13 "explore": true, "groups": true, "healthz": true, "help": true,
14 "internal": true, "login": true, "logout": true, "new": true,
15 "settings": true, "static": true, "g": true,
16}
17
18var (
19 groupPath = regexp.MustCompile(`^[a-z][a-z0-9_-]{0,62}$`)
20 repoName = regexp.MustCompile(`^[a-zA-Z0-9][a-zA-Z0-9._-]{0,62}$`)
21 userName = regexp.MustCompile(`^[a-z0-9][a-z0-9_-]{0,62}$`)
22)
23
24// ValidUsername volgt de auth-server: kleine letters.
25func ValidUsername(s string) error {
26 if !userName.MatchString(s) || reserved[s] {
27 return fmt.Errorf("gebruikersnaam %q is hier niet bruikbaar", s)
28 }
29 return nil
30}
31
32// ValidGroupPath is het pad van een groep in de URL.
33func ValidGroupPath(s string) error {
34 if !groupPath.MatchString(s) || reserved[s] {
35 return fmt.Errorf("groepspad %q is niet bruikbaar", s)
36 }
37 return nil
38}
39
40// ValidRepoName is de repositorynaam zonder .git.
41func ValidRepoName(s string) error {
42 if !repoName.MatchString(s) || strings.HasSuffix(strings.ToLower(s), ".git") || s == "." || s == ".." {
43 return fmt.Errorf("repositorynaam %q is niet bruikbaar", s)
44 }
45 return nil
46}
47
48// ValidTag beperkt release-tags tot een git-ref die niet ontsnapt.
49func ValidTag(s string) error {
50 if s == "" || len(s) > 80 || strings.HasPrefix(s, "-") || strings.Contains(s, "..") {
51 return fmt.Errorf("tag %q is niet bruikbaar", s)
52 }
53 for _, c := range s {
54 ok := (c >= 'a' && c <= 'z') || (c >= 'A' && c <= 'Z') || (c >= '0' && c <= '9') || c == '.' || c == '_' || c == '-'
55 if !ok {
56 return fmt.Errorf("tag %q bevat een verboden teken", s)
57 }
58 }
59 return nil
60}
internal/realip/realip.go added +133 −0
@@ -0,0 +1,133 @@
1 // Package realip haalt het adres van de client achter een reverse proxy vandaan.
2 // X-Forwarded-For en X-Real-IP tellen alleen als de directe verbinding
3 // van een adres op de vertrouwenslijst komt. Een client die zelf een
4 // kop meestuurt, kan zijn adres daarmee niet vervalsen.
5 package realip
6
7 import (
8 "fmt"
9 "net"
10 "net/http"
11 "strings"
12 )
13
14 // Set is een lijst IP-adressen en CIDR-blokken.
15 type Set struct {
16 nets []*net.IPNet
17 }
18
19 // Parse leest IP-adressen en CIDR-blokken. Een lege lijst vertrouwt niemand.
20 func Parse(entries []string) (*Set, error) {
21 s := &Set{}
22 for _, e := range entries {
23 e = strings.TrimSpace(e)
24 if e == "" {
25 continue
26 }
27 if strings.Contains(e, "/") {
28 _, n, err := net.ParseCIDR(e)
29 if err != nil {
30 return nil, fmt.Errorf("trusted_proxies: %q is geen CIDR", e)
31 }
32 s.nets = append(s.nets, n)
33 continue
34 }
35 ip := net.ParseIP(e)
36 if ip == nil {
37 return nil, fmt.Errorf("trusted_proxies: %q is geen IP-adres of CIDR", e)
38 }
39 bits := 32
40 if ip.To4() == nil {
41 bits = 128
42 }
43 s.nets = append(s.nets, &net.IPNet{IP: ip, Mask: net.CIDRMask(bits, bits)})
44 }
45 return s, nil
46 }
47
48 // Contains meldt of ip op de lijst staat.
49 func (s *Set) Contains(ip net.IP) bool {
50 if s == nil || ip == nil {
51 return false
52 }
53 for _, n := range s.nets {
54 if n.Contains(ip) {
55 return true
56 }
57 }
58 return false
59 }
60
61 // ClientIP kiest het clientadres.
62 // remoteAddr is host:poort van de TCP-verbinding. xff is X-Forwarded-For,
63 // xReal is X-Real-IP. In de keten is het clientadres de rechtse hop die
64 // zelf geen vertrouwde proxy is. Zijn alle hops vertrouwd, dan blijft
65 // het adres van de directe verbinding staan.
66 func ClientIP(remoteAddr, xff, xReal string, trusted *Set) string {
67 peer, _, err := net.SplitHostPort(remoteAddr)
68 if err != nil {
69 peer = remoteAddr
70 }
71 peerIP := net.ParseIP(peer)
72 if trusted == nil || peerIP == nil || !trusted.Contains(peerIP) {
73 return peer
74 }
75 if ip := rightmostUntrusted(xff, trusted); ip != nil {
76 return ip.String()
77 }
78 if ip := parseToken(xReal); ip != nil && !trusted.Contains(ip) {
79 return ip.String()
80 }
81 return peer
82 }
83
84 func rightmostUntrusted(xff string, trusted *Set) net.IP {
85 if strings.TrimSpace(xff) == "" {
86 return nil
87 }
88 parts := strings.Split(xff, ",")
89 for i := len(parts) - 1; i >= 0; i-- {
90 ip := parseToken(parts[i])
91 if ip == nil {
92 continue
93 }
94 if !trusted.Contains(ip) {
95 return ip
96 }
97 }
98 return nil
99 }
100
101 func parseToken(s string) net.IP {
102 s = strings.TrimSpace(s)
103 s = strings.Trim(s, `"`)
104 if s == "" {
105 return nil
106 }
107 if h, _, err := net.SplitHostPort(s); err == nil {
108 s = h
109 }
110 s = strings.Trim(s, "[]")
111 return net.ParseIP(s)
112 }
113
114 // FromRequest leest de koppen van r.
115 func FromRequest(r *http.Request, trusted *Set) string {
116 xff := strings.Join(r.Header.Values("X-Forwarded-For"), ", ")
117 return ClientIP(r.RemoteAddr, xff, r.Header.Get("X-Real-IP"), trusted)
118 }
119
120 // Apply zet r.RemoteAddr op het clientadres. De poort blijft alleen staan
121 // als het adres niet uit een proxykop komt; die poort is anders van de proxy.
122 func Apply(r *http.Request, trusted *Set) {
123 ip := FromRequest(r, trusted)
124 host, port, err := net.SplitHostPort(r.RemoteAddr)
125 if err != nil || port == "" {
126 r.RemoteAddr = net.JoinHostPort(ip, "0")
127 return
128 }
129 if parsed, got := net.ParseIP(host), net.ParseIP(ip); parsed == nil || got == nil || !parsed.Equal(got) {
130 port = "0"
131 }
132 r.RemoteAddr = net.JoinHostPort(ip, port)
133 }
@@ -0,0 +1,133 @@
1// Package realip haalt het adres van de client achter een reverse proxy vandaan.
2// X-Forwarded-For en X-Real-IP tellen alleen als de directe verbinding
3// van een adres op de vertrouwenslijst komt. Een client die zelf een
4// kop meestuurt, kan zijn adres daarmee niet vervalsen.
5package realip
6
7import (
8 "fmt"
9 "net"
10 "net/http"
11 "strings"
12)
13
14// Set is een lijst IP-adressen en CIDR-blokken.
15type Set struct {
16 nets []*net.IPNet
17}
18
19// Parse leest IP-adressen en CIDR-blokken. Een lege lijst vertrouwt niemand.
20func Parse(entries []string) (*Set, error) {
21 s := &Set{}
22 for _, e := range entries {
23 e = strings.TrimSpace(e)
24 if e == "" {
25 continue
26 }
27 if strings.Contains(e, "/") {
28 _, n, err := net.ParseCIDR(e)
29 if err != nil {
30 return nil, fmt.Errorf("trusted_proxies: %q is geen CIDR", e)
31 }
32 s.nets = append(s.nets, n)
33 continue
34 }
35 ip := net.ParseIP(e)
36 if ip == nil {
37 return nil, fmt.Errorf("trusted_proxies: %q is geen IP-adres of CIDR", e)
38 }
39 bits := 32
40 if ip.To4() == nil {
41 bits = 128
42 }
43 s.nets = append(s.nets, &net.IPNet{IP: ip, Mask: net.CIDRMask(bits, bits)})
44 }
45 return s, nil
46}
47
48// Contains meldt of ip op de lijst staat.
49func (s *Set) Contains(ip net.IP) bool {
50 if s == nil || ip == nil {
51 return false
52 }
53 for _, n := range s.nets {
54 if n.Contains(ip) {
55 return true
56 }
57 }
58 return false
59}
60
61// ClientIP kiest het clientadres.
62// remoteAddr is host:poort van de TCP-verbinding. xff is X-Forwarded-For,
63// xReal is X-Real-IP. In de keten is het clientadres de rechtse hop die
64// zelf geen vertrouwde proxy is. Zijn alle hops vertrouwd, dan blijft
65// het adres van de directe verbinding staan.
66func ClientIP(remoteAddr, xff, xReal string, trusted *Set) string {
67 peer, _, err := net.SplitHostPort(remoteAddr)
68 if err != nil {
69 peer = remoteAddr
70 }
71 peerIP := net.ParseIP(peer)
72 if trusted == nil || peerIP == nil || !trusted.Contains(peerIP) {
73 return peer
74 }
75 if ip := rightmostUntrusted(xff, trusted); ip != nil {
76 return ip.String()
77 }
78 if ip := parseToken(xReal); ip != nil && !trusted.Contains(ip) {
79 return ip.String()
80 }
81 return peer
82}
83
84func rightmostUntrusted(xff string, trusted *Set) net.IP {
85 if strings.TrimSpace(xff) == "" {
86 return nil
87 }
88 parts := strings.Split(xff, ",")
89 for i := len(parts) - 1; i >= 0; i-- {
90 ip := parseToken(parts[i])
91 if ip == nil {
92 continue
93 }
94 if !trusted.Contains(ip) {
95 return ip
96 }
97 }
98 return nil
99}
100
101func parseToken(s string) net.IP {
102 s = strings.TrimSpace(s)
103 s = strings.Trim(s, `"`)
104 if s == "" {
105 return nil
106 }
107 if h, _, err := net.SplitHostPort(s); err == nil {
108 s = h
109 }
110 s = strings.Trim(s, "[]")
111 return net.ParseIP(s)
112}
113
114// FromRequest leest de koppen van r.
115func FromRequest(r *http.Request, trusted *Set) string {
116 xff := strings.Join(r.Header.Values("X-Forwarded-For"), ", ")
117 return ClientIP(r.RemoteAddr, xff, r.Header.Get("X-Real-IP"), trusted)
118}
119
120// Apply zet r.RemoteAddr op het clientadres. De poort blijft alleen staan
121// als het adres niet uit een proxykop komt; die poort is anders van de proxy.
122func Apply(r *http.Request, trusted *Set) {
123 ip := FromRequest(r, trusted)
124 host, port, err := net.SplitHostPort(r.RemoteAddr)
125 if err != nil || port == "" {
126 r.RemoteAddr = net.JoinHostPort(ip, "0")
127 return
128 }
129 if parsed, got := net.ParseIP(host), net.ParseIP(ip); parsed == nil || got == nil || !parsed.Equal(got) {
130 port = "0"
131 }
132 r.RemoteAddr = net.JoinHostPort(ip, port)
133}
internal/realip/realip_test.go added +85 −0
@@ -0,0 +1,85 @@
1 package realip
2
3 import (
4 "net/http"
5 "testing"
6 )
7
8 func TestUntrustedPeerIgnoresForwardedHeaders(t *testing.T) {
9 set, err := Parse([]string{"10.0.0.2"})
10 if err != nil {
11 t.Fatal(err)
12 }
13 got := ClientIP("203.0.113.9:4321", "1.2.3.4", "8.8.8.8", set)
14 if got != "203.0.113.9" {
15 t.Fatalf("onvertrouwde client werd %s", got)
16 }
17 got = ClientIP("203.0.113.9:4321", "1.2.3.4", "8.8.8.8", nil)
18 if got != "203.0.113.9" {
19 t.Fatalf("lege lijst werd %s", got)
20 }
21 }
22
23 func TestRightmostUntrustedHop(t *testing.T) {
24 set, err := Parse([]string{"10.0.0.0/8"})
25 if err != nil {
26 t.Fatal(err)
27 }
28 // De aanvaller zette 6.6.6.6 vooraan. De ingress plakte het echte adres erachter.
29 got := ClientIP("10.0.0.2:443", "6.6.6.6, 198.51.100.20", "", set)
30 if got != "198.51.100.20" {
31 t.Fatalf("kreeg %s", got)
32 }
33 got = ClientIP("10.0.0.2:443", "198.51.100.20", "", set)
34 if got != "198.51.100.20" {
35 t.Fatalf("enkele hop werd %s", got)
36 }
37 }
38
39 func TestRealIPWhenForwardedForMissing(t *testing.T) {
40 set, err := Parse([]string{"10.0.0.2"})
41 if err != nil {
42 t.Fatal(err)
43 }
44 got := ClientIP("10.0.0.2:443", "", "198.51.100.8", set)
45 if got != "198.51.100.8" {
46 t.Fatalf("X-Real-IP werd %s", got)
47 }
48 got = ClientIP("10.0.0.2:443", "", "10.0.0.2", set)
49 if got != "10.0.0.2" {
50 t.Fatalf("alleen proxies, kreeg %s", got)
51 }
52 }
53
54 func TestApplyRewritesRemoteAddr(t *testing.T) {
55 set, err := Parse([]string{"10.0.0.2"})
56 if err != nil {
57 t.Fatal(err)
58 }
59 r, err := http.NewRequest(http.MethodGet, "http://git.timfalken.com/", nil)
60 if err != nil {
61 t.Fatal(err)
62 }
63 r.RemoteAddr = "10.0.0.2:51234"
64 r.Header.Set("X-Forwarded-For", "203.0.113.4")
65 Apply(r, set)
66 if r.RemoteAddr != "203.0.113.4:0" {
67 t.Fatalf("RemoteAddr %s", r.RemoteAddr)
68 }
69
70 r.RemoteAddr = "203.0.113.9:51234"
71 r.Header.Set("X-Forwarded-For", "1.1.1.1")
72 Apply(r, set)
73 if r.RemoteAddr != "203.0.113.9:51234" {
74 t.Fatalf("onvertrouwd bleef niet staan: %s", r.RemoteAddr)
75 }
76 }
77
78 func TestParseRejectsNames(t *testing.T) {
79 if _, err := Parse([]string{"ingress.local"}); err == nil {
80 t.Fatal("een hostnaam hoort geen proxy te zijn")
81 }
82 if _, err := Parse([]string{"10.0.0.0/33"}); err == nil {
83 t.Fatal("ongeldig CIDR")
84 }
85 }
@@ -0,0 +1,85 @@
1package realip
2
3import (
4 "net/http"
5 "testing"
6)
7
8func TestUntrustedPeerIgnoresForwardedHeaders(t *testing.T) {
9 set, err := Parse([]string{"10.0.0.2"})
10 if err != nil {
11 t.Fatal(err)
12 }
13 got := ClientIP("203.0.113.9:4321", "1.2.3.4", "8.8.8.8", set)
14 if got != "203.0.113.9" {
15 t.Fatalf("onvertrouwde client werd %s", got)
16 }
17 got = ClientIP("203.0.113.9:4321", "1.2.3.4", "8.8.8.8", nil)
18 if got != "203.0.113.9" {
19 t.Fatalf("lege lijst werd %s", got)
20 }
21}
22
23func TestRightmostUntrustedHop(t *testing.T) {
24 set, err := Parse([]string{"10.0.0.0/8"})
25 if err != nil {
26 t.Fatal(err)
27 }
28 // De aanvaller zette 6.6.6.6 vooraan. De ingress plakte het echte adres erachter.
29 got := ClientIP("10.0.0.2:443", "6.6.6.6, 198.51.100.20", "", set)
30 if got != "198.51.100.20" {
31 t.Fatalf("kreeg %s", got)
32 }
33 got = ClientIP("10.0.0.2:443", "198.51.100.20", "", set)
34 if got != "198.51.100.20" {
35 t.Fatalf("enkele hop werd %s", got)
36 }
37}
38
39func TestRealIPWhenForwardedForMissing(t *testing.T) {
40 set, err := Parse([]string{"10.0.0.2"})
41 if err != nil {
42 t.Fatal(err)
43 }
44 got := ClientIP("10.0.0.2:443", "", "198.51.100.8", set)
45 if got != "198.51.100.8" {
46 t.Fatalf("X-Real-IP werd %s", got)
47 }
48 got = ClientIP("10.0.0.2:443", "", "10.0.0.2", set)
49 if got != "10.0.0.2" {
50 t.Fatalf("alleen proxies, kreeg %s", got)
51 }
52}
53
54func TestApplyRewritesRemoteAddr(t *testing.T) {
55 set, err := Parse([]string{"10.0.0.2"})
56 if err != nil {
57 t.Fatal(err)
58 }
59 r, err := http.NewRequest(http.MethodGet, "http://git.timfalken.com/", nil)
60 if err != nil {
61 t.Fatal(err)
62 }
63 r.RemoteAddr = "10.0.0.2:51234"
64 r.Header.Set("X-Forwarded-For", "203.0.113.4")
65 Apply(r, set)
66 if r.RemoteAddr != "203.0.113.4:0" {
67 t.Fatalf("RemoteAddr %s", r.RemoteAddr)
68 }
69
70 r.RemoteAddr = "203.0.113.9:51234"
71 r.Header.Set("X-Forwarded-For", "1.1.1.1")
72 Apply(r, set)
73 if r.RemoteAddr != "203.0.113.9:51234" {
74 t.Fatalf("onvertrouwd bleef niet staan: %s", r.RemoteAddr)
75 }
76}
77
78func TestParseRejectsNames(t *testing.T) {
79 if _, err := Parse([]string{"ingress.local"}); err == nil {
80 t.Fatal("een hostnaam hoort geen proxy te zijn")
81 }
82 if _, err := Parse([]string{"10.0.0.0/33"}); err == nil {
83 t.Fatal("ongeldig CIDR")
84 }
85}
internal/runner/runner.go added +395 −0
@@ -0,0 +1,395 @@
1 // Package runner voert pipelinejobs uit, elk in een eigen Docker-container.
2 package runner
3
4 import (
5 "bytes"
6 "context"
7 "fmt"
8 "io"
9 "log/slog"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14 "sync"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/ci"
19 "gitlab.com/Timfa/bluegit/internal/gitrepo"
20 "gitlab.com/Timfa/bluegit/internal/store"
21 "gitlab.com/Timfa/bluegit/internal/webhook"
22 )
23
24 // Runner plant jobs en stuurt het resultaat door naar webhooks.
25 type Runner struct {
26 Store *store.Store
27 GitBin string
28 Docker string
29 Storage string
30 BaseURL string
31 Network string
32 Timeout time.Duration
33 Log *slog.Logger
34 OnEvent func(repoID int64, ev webhook.Event)
35 slots chan struct{}
36 mu sync.RWMutex
37 }
38
39 // SetStorage wijzigt het pad waarop jobs hun clone en artifacts zetten.
40 func (r *Runner) SetStorage(path string) {
41 r.mu.Lock()
42 r.Storage = path
43 r.mu.Unlock()
44 }
45
46 func (r *Runner) storage() string {
47 r.mu.RLock()
48 defer r.mu.RUnlock()
49 return r.Storage
50 }
51
52 // Loop blijft jobs oppakken tot ctx afloopt.
53 func (r *Runner) Loop(ctx context.Context, concurrency int) {
54 if concurrency < 1 {
55 concurrency = 1
56 }
57 r.slots = make(chan struct{}, concurrency)
58 tick := time.NewTicker(2 * time.Second)
59 defer tick.Stop()
60 for {
61 select {
62 case <-ctx.Done():
63 return
64 case <-tick.C:
65 r.Tick(ctx)
66 }
67 }
68 }
69
70 // Tick bekijkt alle open pipelines één keer.
71 // Zonder opslagpad gebeurt er niets.
72 func (r *Runner) Tick(ctx context.Context) {
73 if r.storage() == "" {
74 return
75 }
76 pipes, err := r.Store.ActivePipelines(ctx)
77 if err != nil {
78 r.Log.Error("pipelines", "err", err)
79 return
80 }
81 for _, p := range pipes {
82 r.schedule(ctx, p)
83 }
84 }
85
86 func (r *Runner) schedule(ctx context.Context, p store.Pipeline) {
87 jobs, err := r.Store.JobsByPipeline(ctx, p.ID)
88 if err != nil {
89 r.Log.Error("jobs", "err", err)
90 return
91 }
92 specs := make([]ci.Job, len(jobs))
93 status := map[string]string{}
94 for i, j := range jobs {
95 specs[i] = ci.Job{Name: j.Name, Stage: j.Stage, Needs: j.Needs, NeedsSet: j.NeedsSet, AllowFailure: j.AllowFailure}
96 status[j.Name] = j.Status
97 }
98 for _, j := range jobs {
99 if j.Status != "queued" {
100 continue
101 }
102 switch ci.Gate(specs, status, specs[indexOf(jobs, j.Name)]) {
103 case "skip":
104 _ = r.Store.SkipJob(ctx, j.ID, "overgeslagen omdat een eerdere job mislukte")
105 status[j.Name] = "skipped"
106 case "ready":
107 ok, err := r.Store.MarkJobRunning(ctx, j.ID)
108 if err != nil || !ok {
109 continue
110 }
111 status[j.Name] = "running"
112 job := j
113 pipe := p
114 go r.execute(ctx, pipe, job)
115 }
116 }
117 }
118
119 func indexOf(jobs []store.Job, name string) int {
120 for i, j := range jobs {
121 if j.Name == name {
122 return i
123 }
124 }
125 return 0
126 }
127
128 func (r *Runner) execute(ctx context.Context, p store.Pipeline, job store.Job) {
129 if r.slots != nil {
130 r.slots <- struct{}{}
131 defer func() { <-r.slots }()
132 }
133 before, _ := r.Store.PipelineByID(context.Background(), p.RepoID, p.ID)
134 logText, err := r.runOne(ctx, p, job)
135 status := "success"
136 if err != nil {
137 status = "failed"
138 if logText != "" {
139 logText += "\n"
140 }
141 logText += err.Error() + "\n"
142 }
143 if ferr := r.Store.FinishJob(context.Background(), job.ID, status, logText); ferr != nil {
144 r.Log.Error("job afronden", "err", ferr)
145 }
146 final, rerr := r.Store.RefreshPipelineStatus(context.Background(), p.ID)
147 if rerr != nil {
148 r.Log.Error("pipelinestatus", "err", rerr)
149 return
150 }
151 if before.Status != final && (final == "success" || final == "failed") && r.OnEvent != nil {
152 kind := webhook.EventPipelineSuccess
153 word := "geslaagd"
154 if final == "failed" {
155 kind = webhook.EventPipelineFailure
156 word = "mislukt"
157 }
158 repo, err := r.Store.RepoByID(context.Background(), p.RepoID)
159 if err != nil {
160 return
161 }
162 branch, _ := gitrepo.BranchOfRef(p.Ref)
163 if branch == "" {
164 branch = strings.TrimPrefix(p.Ref, "refs/heads/")
165 }
166 r.OnEvent(p.RepoID, webhook.Event{
167 Type: kind,
168 Project: repo.FullPath(),
169 Branch: branch,
170 Commit: p.CommitSHA,
171 Summary: fmt.Sprintf("pipeline #%d voor %s is %s", p.ID, repo.FullPath(), word),
172 URL: strings.TrimRight(r.BaseURL, "/") + "/" + repo.FullPath() + "/-/pipelines/" + fmt.Sprint(p.ID),
173 PipelineID: fmt.Sprint(p.ID),
174 })
175 }
176 }
177
178 func (r *Runner) runOne(ctx context.Context, p store.Pipeline, job store.Job) (string, error) {
179 if r.Timeout > 0 {
180 var cancel context.CancelFunc
181 ctx, cancel = context.WithTimeout(ctx, r.Timeout)
182 defer cancel()
183 }
184 repo, err := r.Store.RepoByID(ctx, p.RepoID)
185 if err != nil {
186 return "", err
187 }
188 work := filepath.Join(r.storage(), "work", fmt.Sprint(p.ID), job.Name)
189 _ = os.RemoveAll(work)
190 if err := os.MkdirAll(work, 0o755); err != nil {
191 return "", err
192 }
193 bare := gitrepo.Dir(r.storage(), repo.OwnerPath, repo.Name)
194 if _, err := execOut(ctx, r.GitBin, "clone", "--local", bare, work); err != nil {
195 return "", fmt.Errorf("clone: %w", err)
196 }
197 if _, err := execOut(ctx, r.GitBin, "-C", work, "checkout", "--detach", p.CommitSHA); err != nil {
198 return "", fmt.Errorf("checkout %s: %w", p.CommitSHA, err)
199 }
200 if err := r.materialize(ctx, p, job, work); err != nil {
201 return "", err
202 }
203 scriptPath := filepath.Join(work, ".bluegit-job.sh")
204 if err := os.WriteFile(scriptPath, []byte(scriptOf(job.Script)), 0o755); err != nil {
205 return "", err
206 }
207 token, err := r.Store.CreateJobToken(ctx, job.ID)
208 if err != nil {
209 return "", err
210 }
211 env, err := r.environment(ctx, repo, p, job, token)
212 if err != nil {
213 return "", err
214 }
215 if _, err := exec.LookPath(r.Docker); err != nil {
216 return "", fmt.Errorf("docker (%s) is niet beschikbaar; de job draait alleen in een container", r.Docker)
217 }
218 // -e NAAM zonder waarde laat Docker de variabele uit de omgeving van
219 // deze client overnemen. Zo blijft een meerregelige sleutel heel en
220 // staat de waarde niet in de proceslijst.
221 args := []string{"run", "--rm", "--network", r.Network, "-v", work + ":/workspace", "-w", "/workspace"}
222 cmdEnv := append([]string{}, os.Environ()...)
223 for k, v := range env {
224 args = append(args, "-e", k)
225 cmdEnv = append(cmdEnv, k+"="+v)
226 }
227 args = append(args, "--entrypoint", "sh", job.Image, "/workspace/.bluegit-job.sh")
228 cmd := exec.CommandContext(ctx, r.Docker, args...)
229 cmd.Env = cmdEnv
230 var buf bytes.Buffer
231 cmd.Stdout = &buf
232 cmd.Stderr = &buf
233 err = cmd.Run()
234 logText := buf.String()
235 if err != nil {
236 return logText, fmt.Errorf("container eindigde met een fout: %w", err)
237 }
238 if err := r.collect(ctx, job, work); err != nil {
239 return logText, err
240 }
241 return logText, nil
242 }
243
244 func scriptOf(lines string) string {
245 var b strings.Builder
246 b.WriteString("#!/bin/sh\nset -e\ncd /workspace\n")
247 b.WriteString(lines)
248 if !strings.HasSuffix(lines, "\n") {
249 b.WriteByte('\n')
250 }
251 return b.String()
252 }
253
254 func (r *Runner) materialize(ctx context.Context, p store.Pipeline, job store.Job, work string) error {
255 jobs, err := r.Store.JobsByPipeline(ctx, p.ID)
256 if err != nil {
257 return err
258 }
259 wanted := map[string]bool{}
260 if job.NeedsSet {
261 for _, n := range job.Needs {
262 wanted[n] = true
263 }
264 } else {
265 stageOrder := map[string]int{}
266 n := 0
267 for _, j := range jobs {
268 if _, ok := stageOrder[j.Stage]; !ok {
269 stageOrder[j.Stage] = n
270 n++
271 }
272 }
273 my := stageOrder[job.Stage]
274 for _, j := range jobs {
275 if stageOrder[j.Stage] < my {
276 wanted[j.Name] = true
277 }
278 }
279 }
280 for _, j := range jobs {
281 if !wanted[j.Name] || j.Status != "success" {
282 continue
283 }
284 for _, rel := range j.ArtifactPaths {
285 src, err := r.Store.ArtifactPath(ctx, p.ID, j.Name, rel)
286 if err != nil {
287 continue
288 }
289 dst := filepath.Join(work, filepath.FromSlash(rel))
290 if err := copyFile(src, dst); err != nil {
291 return err
292 }
293 }
294 }
295 return nil
296 }
297
298 func (r *Runner) collect(ctx context.Context, job store.Job, work string) error {
299 var expires *time.Time
300 if job.ArtifactExpire > 0 {
301 t := time.Now().Add(job.ArtifactExpire)
302 expires = &t
303 }
304 for _, rel := range job.ArtifactPaths {
305 src := filepath.Join(work, filepath.FromSlash(rel))
306 info, err := os.Stat(src)
307 if err != nil || info.IsDir() {
308 return fmt.Errorf("artifact %s ontbreekt", rel)
309 }
310 dst := filepath.Join(r.storage(), "artifacts", fmt.Sprint(job.ID), filepath.FromSlash(rel))
311 if err := copyFile(src, dst); err != nil {
312 return err
313 }
314 if err := r.Store.AddArtifact(ctx, job.ID, rel, dst, info.Size(), expires); err != nil {
315 return err
316 }
317 }
318 return nil
319 }
320
321 func (r *Runner) environment(ctx context.Context, repo store.Repo, p store.Pipeline, job store.Job, token string) (map[string]string, error) {
322 branch := strings.TrimPrefix(p.Ref, "refs/heads/")
323 patterns, err := r.Store.ProtectedPatterns(ctx, repo.ID)
324 if err != nil {
325 return nil, err
326 }
327 refProtected := access.BranchProtected(patterns, branch)
328 env := map[string]string{}
329 if repo.OwnerKind == "group" {
330 groupSecrets, err := r.Store.SecretValues(ctx, "group", repo.OwnerID, refProtected)
331 if err != nil {
332 return nil, err
333 }
334 for k, v := range groupSecrets {
335 env[k] = v
336 }
337 }
338 repoSecrets, err := r.Store.SecretValues(ctx, "repo", repo.ID, refProtected)
339 if err != nil {
340 return nil, err
341 }
342 for k, v := range repoSecrets {
343 env[k] = v
344 }
345 for k, v := range job.Variables {
346 env[k] = v
347 }
348 env["CI"] = "true"
349 env["CI_COMMIT_SHA"] = p.CommitSHA
350 env["CI_COMMIT_BRANCH"] = branch
351 env["CI_COMMIT_REF"] = p.Ref
352 env["CI_PROJECT_PATH"] = repo.FullPath()
353 env["CI_PIPELINE_ID"] = fmt.Sprint(p.ID)
354 env["CI_JOB_ID"] = fmt.Sprint(job.ID)
355 env["CI_JOB_NAME"] = job.Name
356 env["CI_JOB_TOKEN"] = token
357 env["CI_API_URL"] = strings.TrimRight(r.BaseURL, "/") + "/api/v1"
358 return env, nil
359 }
360
361 func copyFile(src, dst string) error {
362 if err := os.MkdirAll(filepath.Dir(dst), 0o755); err != nil {
363 return err
364 }
365 in, err := os.Open(src)
366 if err != nil {
367 return err
368 }
369 defer in.Close()
370 out, err := os.OpenFile(dst, os.O_CREATE|os.O_TRUNC|os.O_WRONLY, 0o644)
371 if err != nil {
372 return err
373 }
374 defer out.Close()
375 _, err = io.Copy(out, in)
376 return err
377 }
378
379 func execOut(ctx context.Context, bin string, args ...string) (string, error) {
380 if bin == "" {
381 bin = "git"
382 }
383 cmd := exec.CommandContext(ctx, bin, args...)
384 var stdout, stderr bytes.Buffer
385 cmd.Stdout = &stdout
386 cmd.Stderr = &stderr
387 if err := cmd.Run(); err != nil {
388 msg := strings.TrimSpace(stderr.String())
389 if msg == "" {
390 msg = err.Error()
391 }
392 return "", fmt.Errorf("%s", msg)
393 }
394 return stdout.String(), nil
395 }
@@ -0,0 +1,395 @@
1// Package runner voert pipelinejobs uit, elk in een eigen Docker-container.
2package runner
3
4import (
5 "bytes"
6 "context"
7 "fmt"
8 "io"
9 "log/slog"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14 "sync"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/ci"
19 "gitlab.com/Timfa/bluegit/internal/gitrepo"
20 "gitlab.com/Timfa/bluegit/internal/store"
21 "gitlab.com/Timfa/bluegit/internal/webhook"
22)
23
24// Runner plant jobs en stuurt het resultaat door naar webhooks.
25type Runner struct {
26 Store *store.Store
27 GitBin string
28 Docker string
29 Storage string
30 BaseURL string
31 Network string
32 Timeout time.Duration
33 Log *slog.Logger
34 OnEvent func(repoID int64, ev webhook.Event)
35 slots chan struct{}
36 mu sync.RWMutex
37}
38
39// SetStorage wijzigt het pad waarop jobs hun clone en artifacts zetten.
40func (r *Runner) SetStorage(path string) {
41 r.mu.Lock()
42 r.Storage = path
43 r.mu.Unlock()
44}
45
46func (r *Runner) storage() string {
47 r.mu.RLock()
48 defer r.mu.RUnlock()
49 return r.Storage
50}
51
52// Loop blijft jobs oppakken tot ctx afloopt.
53func (r *Runner) Loop(ctx context.Context, concurrency int) {
54 if concurrency < 1 {
55 concurrency = 1
56 }
57 r.slots = make(chan struct{}, concurrency)
58 tick := time.NewTicker(2 * time.Second)
59 defer tick.Stop()
60 for {
61 select {
62 case <-ctx.Done():
63 return
64 case <-tick.C:
65 r.Tick(ctx)
66 }
67 }
68}
69
70// Tick bekijkt alle open pipelines één keer.
71// Zonder opslagpad gebeurt er niets.
72func (r *Runner) Tick(ctx context.Context) {
73 if r.storage() == "" {
74 return
75 }
76 pipes, err := r.Store.ActivePipelines(ctx)
77 if err != nil {
78 r.Log.Error("pipelines", "err", err)
79 return
80 }
81 for _, p := range pipes {
82 r.schedule(ctx, p)
83 }
84}
85
86func (r *Runner) schedule(ctx context.Context, p store.Pipeline) {
87 jobs, err := r.Store.JobsByPipeline(ctx, p.ID)
88 if err != nil {
89 r.Log.Error("jobs", "err", err)
90 return
91 }
92 specs := make([]ci.Job, len(jobs))
93 status := map[string]string{}
94 for i, j := range jobs {
95 specs[i] = ci.Job{Name: j.Name, Stage: j.Stage, Needs: j.Needs, NeedsSet: j.NeedsSet, AllowFailure: j.AllowFailure}
96 status[j.Name] = j.Status
97 }
98 for _, j := range jobs {
99 if j.Status != "queued" {
100 continue
101 }
102 switch ci.Gate(specs, status, specs[indexOf(jobs, j.Name)]) {
103 case "skip":
104 _ = r.Store.SkipJob(ctx, j.ID, "overgeslagen omdat een eerdere job mislukte")
105 status[j.Name] = "skipped"
106 case "ready":
107 ok, err := r.Store.MarkJobRunning(ctx, j.ID)
108 if err != nil || !ok {
109 continue
110 }
111 status[j.Name] = "running"
112 job := j
113 pipe := p
114 go r.execute(ctx, pipe, job)
115 }
116 }
117}
118
119func indexOf(jobs []store.Job, name string) int {
120 for i, j := range jobs {
121 if j.Name == name {
122 return i
123 }
124 }
125 return 0
126}
127
128func (r *Runner) execute(ctx context.Context, p store.Pipeline, job store.Job) {
129 if r.slots != nil {
130 r.slots <- struct{}{}
131 defer func() { <-r.slots }()
132 }
133 before, _ := r.Store.PipelineByID(context.Background(), p.RepoID, p.ID)
134 logText, err := r.runOne(ctx, p, job)
135 status := "success"
136 if err != nil {
137 status = "failed"
138 if logText != "" {
139 logText += "\n"
140 }
141 logText += err.Error() + "\n"
142 }
143 if ferr := r.Store.FinishJob(context.Background(), job.ID, status, logText); ferr != nil {
144 r.Log.Error("job afronden", "err", ferr)
145 }
146 final, rerr := r.Store.RefreshPipelineStatus(context.Background(), p.ID)
147 if rerr != nil {
148 r.Log.Error("pipelinestatus", "err", rerr)
149 return
150 }
151 if before.Status != final && (final == "success" || final == "failed") && r.OnEvent != nil {
152 kind := webhook.EventPipelineSuccess
153 word := "geslaagd"
154 if final == "failed" {
155 kind = webhook.EventPipelineFailure
156 word = "mislukt"
157 }
158 repo, err := r.Store.RepoByID(context.Background(), p.RepoID)
159 if err != nil {
160 return
161 }
162 branch, _ := gitrepo.BranchOfRef(p.Ref)
163 if branch == "" {
164 branch = strings.TrimPrefix(p.Ref, "refs/heads/")
165 }
166 r.OnEvent(p.RepoID, webhook.Event{
167 Type: kind,
168 Project: repo.FullPath(),
169 Branch: branch,
170 Commit: p.CommitSHA,
171 Summary: fmt.Sprintf("pipeline #%d voor %s is %s", p.ID, repo.FullPath(), word),
172 URL: strings.TrimRight(r.BaseURL, "/") + "/" + repo.FullPath() + "/-/pipelines/" + fmt.Sprint(p.ID),
173 PipelineID: fmt.Sprint(p.ID),
174 })
175 }
176}
177
178func (r *Runner) runOne(ctx context.Context, p store.Pipeline, job store.Job) (string, error) {
179 if r.Timeout > 0 {
180 var cancel context.CancelFunc
181 ctx, cancel = context.WithTimeout(ctx, r.Timeout)
182 defer cancel()
183 }
184 repo, err := r.Store.RepoByID(ctx, p.RepoID)
185 if err != nil {
186 return "", err
187 }
188 work := filepath.Join(r.storage(), "work", fmt.Sprint(p.ID), job.Name)
189 _ = os.RemoveAll(work)
190 if err := os.MkdirAll(work, 0o755); err != nil {
191 return "", err
192 }
193 bare := gitrepo.Dir(r.storage(), repo.OwnerPath, repo.Name)
194 if _, err := execOut(ctx, r.GitBin, "clone", "--local", bare, work); err != nil {
195 return "", fmt.Errorf("clone: %w", err)
196 }
197 if _, err := execOut(ctx, r.GitBin, "-C", work, "checkout", "--detach", p.CommitSHA); err != nil {
198 return "", fmt.Errorf("checkout %s: %w", p.CommitSHA, err)
199 }
200 if err := r.materialize(ctx, p, job, work); err != nil {
201 return "", err
202 }
203 scriptPath := filepath.Join(work, ".bluegit-job.sh")
204 if err := os.WriteFile(scriptPath, []byte(scriptOf(job.Script)), 0o755); err != nil {
205 return "", err
206 }
207 token, err := r.Store.CreateJobToken(ctx, job.ID)
208 if err != nil {
209 return "", err
210 }
211 env, err := r.environment(ctx, repo, p, job, token)
212 if err != nil {
213 return "", err
214 }
215 if _, err := exec.LookPath(r.Docker); err != nil {
216 return "", fmt.Errorf("docker (%s) is niet beschikbaar; de job draait alleen in een container", r.Docker)
217 }
218 // -e NAAM zonder waarde laat Docker de variabele uit de omgeving van
219 // deze client overnemen. Zo blijft een meerregelige sleutel heel en
220 // staat de waarde niet in de proceslijst.
221 args := []string{"run", "--rm", "--network", r.Network, "-v", work + ":/workspace", "-w", "/workspace"}
222 cmdEnv := append([]string{}, os.Environ()...)
223 for k, v := range env {
224 args = append(args, "-e", k)
225 cmdEnv = append(cmdEnv, k+"="+v)
226 }
227 args = append(args, "--entrypoint", "sh", job.Image, "/workspace/.bluegit-job.sh")
228 cmd := exec.CommandContext(ctx, r.Docker, args...)
229 cmd.Env = cmdEnv
230 var buf bytes.Buffer
231 cmd.Stdout = &buf
232 cmd.Stderr = &buf
233 err = cmd.Run()
234 logText := buf.String()
235 if err != nil {
236 return logText, fmt.Errorf("container eindigde met een fout: %w", err)
237 }
238 if err := r.collect(ctx, job, work); err != nil {
239 return logText, err
240 }
241 return logText, nil
242}
243
244func scriptOf(lines string) string {
245 var b strings.Builder
246 b.WriteString("#!/bin/sh\nset -e\ncd /workspace\n")
247 b.WriteString(lines)
248 if !strings.HasSuffix(lines, "\n") {
249 b.WriteByte('\n')
250 }
251 return b.String()
252}
253
254func (r *Runner) materialize(ctx context.Context, p store.Pipeline, job store.Job, work string) error {
255 jobs, err := r.Store.JobsByPipeline(ctx, p.ID)
256 if err != nil {
257 return err
258 }
259 wanted := map[string]bool{}
260 if job.NeedsSet {
261 for _, n := range job.Needs {
262 wanted[n] = true
263 }
264 } else {
265 stageOrder := map[string]int{}
266 n := 0
267 for _, j := range jobs {
268 if _, ok := stageOrder[j.Stage]; !ok {
269 stageOrder[j.Stage] = n
270 n++
271 }
272 }
273 my := stageOrder[job.Stage]
274 for _, j := range jobs {
275 if stageOrder[j.Stage] < my {
276 wanted[j.Name] = true
277 }
278 }
279 }
280 for _, j := range jobs {
281 if !wanted[j.Name] || j.Status != "success" {
282 continue
283 }
284 for _, rel := range j.ArtifactPaths {
285 src, err := r.Store.ArtifactPath(ctx, p.ID, j.Name, rel)
286 if err != nil {
287 continue
288 }
289 dst := filepath.Join(work, filepath.FromSlash(rel))
290 if err := copyFile(src, dst); err != nil {
291 return err
292 }
293 }
294 }
295 return nil
296}
297
298func (r *Runner) collect(ctx context.Context, job store.Job, work string) error {
299 var expires *time.Time
300 if job.ArtifactExpire > 0 {
301 t := time.Now().Add(job.ArtifactExpire)
302 expires = &t
303 }
304 for _, rel := range job.ArtifactPaths {
305 src := filepath.Join(work, filepath.FromSlash(rel))
306 info, err := os.Stat(src)
307 if err != nil || info.IsDir() {
308 return fmt.Errorf("artifact %s ontbreekt", rel)
309 }
310 dst := filepath.Join(r.storage(), "artifacts", fmt.Sprint(job.ID), filepath.FromSlash(rel))
311 if err := copyFile(src, dst); err != nil {
312 return err
313 }
314 if err := r.Store.AddArtifact(ctx, job.ID, rel, dst, info.Size(), expires); err != nil {
315 return err
316 }
317 }
318 return nil
319}
320
321func (r *Runner) environment(ctx context.Context, repo store.Repo, p store.Pipeline, job store.Job, token string) (map[string]string, error) {
322 branch := strings.TrimPrefix(p.Ref, "refs/heads/")
323 patterns, err := r.Store.ProtectedPatterns(ctx, repo.ID)
324 if err != nil {
325 return nil, err
326 }
327 refProtected := access.BranchProtected(patterns, branch)
328 env := map[string]string{}
329 if repo.OwnerKind == "group" {
330 groupSecrets, err := r.Store.SecretValues(ctx, "group", repo.OwnerID, refProtected)
331 if err != nil {
332 return nil, err
333 }
334 for k, v := range groupSecrets {
335 env[k] = v
336 }
337 }
338 repoSecrets, err := r.Store.SecretValues(ctx, "repo", repo.ID, refProtected)
339 if err != nil {
340 return nil, err
341 }
342 for k, v := range repoSecrets {
343 env[k] = v
344 }
345 for k, v := range job.Variables {
346 env[k] = v
347 }
348 env["CI"] = "true"
349 env["CI_COMMIT_SHA"] = p.CommitSHA
350 env["CI_COMMIT_BRANCH"] = branch
351 env["CI_COMMIT_REF"] = p.Ref
352 env["CI_PROJECT_PATH"] = repo.FullPath()
353 env["CI_PIPELINE_ID"] = fmt.Sprint(p.ID)
354 env["CI_JOB_ID"] = fmt.Sprint(job.ID)
355 env["CI_JOB_NAME"] = job.Name
356 env["CI_JOB_TOKEN"] = token
357 env["CI_API_URL"] = strings.TrimRight(r.BaseURL, "/") + "/api/v1"
358 return env, nil
359}
360
361func copyFile(src, dst string) error {
362 if err := os.MkdirAll(filepath.Dir(dst), 0o755); err != nil {
363 return err
364 }
365 in, err := os.Open(src)
366 if err != nil {
367 return err
368 }
369 defer in.Close()
370 out, err := os.OpenFile(dst, os.O_CREATE|os.O_TRUNC|os.O_WRONLY, 0o644)
371 if err != nil {
372 return err
373 }
374 defer out.Close()
375 _, err = io.Copy(out, in)
376 return err
377}
378
379func execOut(ctx context.Context, bin string, args ...string) (string, error) {
380 if bin == "" {
381 bin = "git"
382 }
383 cmd := exec.CommandContext(ctx, bin, args...)
384 var stdout, stderr bytes.Buffer
385 cmd.Stdout = &stdout
386 cmd.Stderr = &stderr
387 if err := cmd.Run(); err != nil {
388 msg := strings.TrimSpace(stderr.String())
389 if msg == "" {
390 msg = err.Error()
391 }
392 return "", fmt.Errorf("%s", msg)
393 }
394 return stdout.String(), nil
395}
internal/secretbox/secretbox.go added +45 −0
@@ -0,0 +1,45 @@
1 // Package secretbox versleutelt geheimen met AES-GCM.
2 package secretbox
3
4 import (
5 "crypto/aes"
6 "crypto/cipher"
7 "crypto/rand"
8 "fmt"
9 "io"
10 )
11
12 // Encrypt versleutelt plaintext. nonce is 12 bytes.
13 func Encrypt(key []byte, plaintext string) (nonce, ciphertext []byte, err error) {
14 block, err := aes.NewCipher(key)
15 if err != nil {
16 return nil, nil, fmt.Errorf("sleutel: %w", err)
17 }
18 gcm, err := cipher.NewGCM(block)
19 if err != nil {
20 return nil, nil, err
21 }
22 nonce = make([]byte, gcm.NonceSize())
23 if _, err := io.ReadFull(rand.Reader, nonce); err != nil {
24 return nil, nil, err
25 }
26 ciphertext = gcm.Seal(nil, nonce, []byte(plaintext), nil)
27 return nonce, ciphertext, nil
28 }
29
30 // Decrypt draait Encrypt terug.
31 func Decrypt(key, nonce, ciphertext []byte) (string, error) {
32 block, err := aes.NewCipher(key)
33 if err != nil {
34 return "", err
35 }
36 gcm, err := cipher.NewGCM(block)
37 if err != nil {
38 return "", err
39 }
40 plain, err := gcm.Open(nil, nonce, ciphertext, nil)
41 if err != nil {
42 return "", fmt.Errorf("geheim ontcijferen mislukt")
43 }
44 return string(plain), nil
45 }
@@ -0,0 +1,45 @@
1// Package secretbox versleutelt geheimen met AES-GCM.
2package secretbox
3
4import (
5 "crypto/aes"
6 "crypto/cipher"
7 "crypto/rand"
8 "fmt"
9 "io"
10)
11
12// Encrypt versleutelt plaintext. nonce is 12 bytes.
13func Encrypt(key []byte, plaintext string) (nonce, ciphertext []byte, err error) {
14 block, err := aes.NewCipher(key)
15 if err != nil {
16 return nil, nil, fmt.Errorf("sleutel: %w", err)
17 }
18 gcm, err := cipher.NewGCM(block)
19 if err != nil {
20 return nil, nil, err
21 }
22 nonce = make([]byte, gcm.NonceSize())
23 if _, err := io.ReadFull(rand.Reader, nonce); err != nil {
24 return nil, nil, err
25 }
26 ciphertext = gcm.Seal(nil, nonce, []byte(plaintext), nil)
27 return nonce, ciphertext, nil
28}
29
30// Decrypt draait Encrypt terug.
31func Decrypt(key, nonce, ciphertext []byte) (string, error) {
32 block, err := aes.NewCipher(key)
33 if err != nil {
34 return "", err
35 }
36 gcm, err := cipher.NewGCM(block)
37 if err != nil {
38 return "", err
39 }
40 plain, err := gcm.Open(nil, nonce, ciphertext, nil)
41 if err != nil {
42 return "", fmt.Errorf("geheim ontcijferen mislukt")
43 }
44 return string(plain), nil
45}
internal/server/api.go added +184 −0
@@ -0,0 +1,184 @@
1 package server
2
3 import (
4 "encoding/json"
5 "io"
6 "net/http"
7 "os"
8 "path/filepath"
9 "strings"
10
11 "gitlab.com/Timfa/bluegit/internal/access"
12 "gitlab.com/Timfa/bluegit/internal/gitrepo"
13 "gitlab.com/Timfa/bluegit/internal/names"
14 "gitlab.com/Timfa/bluegit/internal/store"
15 "gitlab.com/Timfa/bluegit/internal/webhook"
16 )
17
18 type releaseRequest struct {
19 Tag string `json:"tag"`
20 Commit string `json:"commit"`
21 Name string `json:"name"`
22 Body string `json:"body"`
23 Assets []struct {
24 Job string `json:"job"`
25 Path string `json:"path"`
26 Name string `json:"name"`
27 } `json:"assets"`
28 }
29
30 func (s *Server) createRelease(w http.ResponseWriter, r *http.Request) {
31 if s.StoragePath() == "" {
32 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
33 return
34 }
35 repo, err := s.Store.RepoByPath(r.Context(), r.PathValue("owner"), r.PathValue("repo"))
36 if err != nil {
37 http.NotFound(w, r)
38 return
39 }
40 token := bearer(r)
41 var job store.Job
42 var author int64
43 if strings.HasPrefix(token, "bgj_") {
44 job, err = s.Store.JobByToken(r.Context(), token)
45 if err != nil || job.RepoID != repo.ID || job.Status != "running" {
46 http.Error(w, "job-token ongeldig", http.StatusUnauthorized)
47 return
48 }
49 } else if strings.HasPrefix(token, "bg_") {
50 u, err := s.Store.UserByToken(r.Context(), token)
51 if err != nil {
52 http.Error(w, "token ongeldig", http.StatusUnauthorized)
53 return
54 }
55 role, err := s.Store.EffectiveRole(r.Context(), u.ID, repo.ID)
56 if err != nil || !role.AtLeast(access.RoleMaintainer) {
57 http.Error(w, "alleen een beheerder", http.StatusForbidden)
58 return
59 }
60 author = u.ID
61 } else {
62 http.Error(w, "token ontbreekt", http.StatusUnauthorized)
63 return
64 }
65 var req releaseRequest
66 if err := json.NewDecoder(io.LimitReader(r.Body, 1<<20)).Decode(&req); err != nil {
67 http.Error(w, "json", http.StatusBadRequest)
68 return
69 }
70 if err := names.ValidTag(req.Tag); err != nil {
71 http.Error(w, err.Error(), http.StatusBadRequest)
72 return
73 }
74 if !safeSHA(req.Commit) {
75 http.Error(w, "commit ontbreekt", http.StatusBadRequest)
76 return
77 }
78 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
79 if !gitrepo.HasCommit(r.Context(), s.Git, dir, req.Commit) {
80 http.Error(w, "commit niet in deze repository", http.StatusBadRequest)
81 return
82 }
83 if req.Name == "" {
84 req.Name = req.Tag
85 }
86 if job.ID == 0 && len(req.Assets) > 0 {
87 http.Error(w, "assets horen bij een job-token", http.StatusBadRequest)
88 return
89 }
90 var assets []store.ReleaseAsset
91 for _, a := range req.Assets {
92 if a.Name == "" {
93 a.Name = filepath.Base(a.Path)
94 }
95 if err := names.ValidRepoName(strings.ReplaceAll(a.Name, ".", "x")); err != nil && strings.Contains(a.Name, "..") {
96 http.Error(w, "assetnaam", http.StatusBadRequest)
97 return
98 }
99 if strings.Contains(a.Name, "/") || strings.Contains(a.Name, "..") || a.Path == "" {
100 http.Error(w, "assetnaam", http.StatusBadRequest)
101 return
102 }
103 src, err := s.Store.ArtifactPath(r.Context(), job.PipelineID, a.Job, a.Path)
104 if err != nil {
105 http.Error(w, "artifact niet gevonden: "+a.Job+" "+a.Path, http.StatusBadRequest)
106 return
107 }
108 info, err := os.Stat(src)
109 if err != nil {
110 http.Error(w, "artifact ontbreekt op schijf", http.StatusBadRequest)
111 return
112 }
113 dst := filepath.Join(s.StoragePath(), "releases", repo.OwnerPath, repo.Name, req.Tag, a.Name)
114 if err := copyRelease(src, dst); err != nil {
115 http.Error(w, "asset kopiëren", http.StatusInternalServerError)
116 return
117 }
118 assets = append(assets, store.ReleaseAsset{Name: a.Name, StoragePath: dst, Size: info.Size()})
119 }
120 if err := gitrepo.Tag(r.Context(), s.Git, dir, req.Tag, req.Commit, req.Name); err != nil {
121 http.Error(w, "tag: "+err.Error(), http.StatusBadRequest)
122 return
123 }
124 id, err := s.Store.CreateRelease(r.Context(), repo.ID, req.Tag, req.Commit, req.Name, req.Body, author, job.ID, assets)
125 if err != nil {
126 http.Error(w, err.Error(), http.StatusBadRequest)
127 return
128 }
129 s.Dispatch(repo.ID, webhook.Event{
130 Type: webhook.EventRelease, Project: repo.FullPath(), Commit: req.Commit,
131 ReleaseTag: req.Tag, Summary: "release " + req.Tag + " van " + repo.FullPath() + " gepubliceerd",
132 URL: strings.TrimRight(s.Cfg.BaseURL, "/") + repoURL(repo) + "/-/releases",
133 })
134 w.Header().Set("Content-Type", "application/json")
135 w.WriteHeader(http.StatusCreated)
136 _ = json.NewEncoder(w).Encode(map[string]any{"id": id, "tag": req.Tag, "commit": req.Commit})
137 }
138
139 func (s *Server) releaseAsset(w http.ResponseWriter, r *http.Request) {
140 _, repo, _, ok := s.guard(w, r, access.RoleReadonly)
141 if !ok {
142 return
143 }
144 rel, err := s.Store.ReleaseByTag(r.Context(), repo.ID, r.PathValue("tag"))
145 if err != nil {
146 http.NotFound(w, r)
147 return
148 }
149 name := r.PathValue("name")
150 for _, a := range rel.Assets {
151 if a.Name == name {
152 w.Header().Set("Content-Disposition", "attachment; filename=\""+strings.ReplaceAll(name, "\"", "")+"\"")
153 http.ServeFile(w, r, a.StoragePath)
154 return
155 }
156 }
157 http.NotFound(w, r)
158 }
159
160 func bearer(r *http.Request) string {
161 h := r.Header.Get("Authorization")
162 if strings.HasPrefix(strings.ToLower(h), "bearer ") {
163 return strings.TrimSpace(h[7:])
164 }
165 return ""
166 }
167
168 func copyRelease(src, dst string) error {
169 if err := os.MkdirAll(filepath.Dir(dst), 0o755); err != nil {
170 return err
171 }
172 in, err := os.Open(src)
173 if err != nil {
174 return err
175 }
176 defer in.Close()
177 out, err := os.OpenFile(dst, os.O_CREATE|os.O_TRUNC|os.O_WRONLY, 0o644)
178 if err != nil {
179 return err
180 }
181 defer out.Close()
182 _, err = io.Copy(out, in)
183 return err
184 }
@@ -0,0 +1,184 @@
1package server
2
3import (
4 "encoding/json"
5 "io"
6 "net/http"
7 "os"
8 "path/filepath"
9 "strings"
10
11 "gitlab.com/Timfa/bluegit/internal/access"
12 "gitlab.com/Timfa/bluegit/internal/gitrepo"
13 "gitlab.com/Timfa/bluegit/internal/names"
14 "gitlab.com/Timfa/bluegit/internal/store"
15 "gitlab.com/Timfa/bluegit/internal/webhook"
16)
17
18type releaseRequest struct {
19 Tag string `json:"tag"`
20 Commit string `json:"commit"`
21 Name string `json:"name"`
22 Body string `json:"body"`
23 Assets []struct {
24 Job string `json:"job"`
25 Path string `json:"path"`
26 Name string `json:"name"`
27 } `json:"assets"`
28}
29
30func (s *Server) createRelease(w http.ResponseWriter, r *http.Request) {
31 if s.StoragePath() == "" {
32 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
33 return
34 }
35 repo, err := s.Store.RepoByPath(r.Context(), r.PathValue("owner"), r.PathValue("repo"))
36 if err != nil {
37 http.NotFound(w, r)
38 return
39 }
40 token := bearer(r)
41 var job store.Job
42 var author int64
43 if strings.HasPrefix(token, "bgj_") {
44 job, err = s.Store.JobByToken(r.Context(), token)
45 if err != nil || job.RepoID != repo.ID || job.Status != "running" {
46 http.Error(w, "job-token ongeldig", http.StatusUnauthorized)
47 return
48 }
49 } else if strings.HasPrefix(token, "bg_") {
50 u, err := s.Store.UserByToken(r.Context(), token)
51 if err != nil {
52 http.Error(w, "token ongeldig", http.StatusUnauthorized)
53 return
54 }
55 role, err := s.Store.EffectiveRole(r.Context(), u.ID, repo.ID)
56 if err != nil || !role.AtLeast(access.RoleMaintainer) {
57 http.Error(w, "alleen een beheerder", http.StatusForbidden)
58 return
59 }
60 author = u.ID
61 } else {
62 http.Error(w, "token ontbreekt", http.StatusUnauthorized)
63 return
64 }
65 var req releaseRequest
66 if err := json.NewDecoder(io.LimitReader(r.Body, 1<<20)).Decode(&req); err != nil {
67 http.Error(w, "json", http.StatusBadRequest)
68 return
69 }
70 if err := names.ValidTag(req.Tag); err != nil {
71 http.Error(w, err.Error(), http.StatusBadRequest)
72 return
73 }
74 if !safeSHA(req.Commit) {
75 http.Error(w, "commit ontbreekt", http.StatusBadRequest)
76 return
77 }
78 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
79 if !gitrepo.HasCommit(r.Context(), s.Git, dir, req.Commit) {
80 http.Error(w, "commit niet in deze repository", http.StatusBadRequest)
81 return
82 }
83 if req.Name == "" {
84 req.Name = req.Tag
85 }
86 if job.ID == 0 && len(req.Assets) > 0 {
87 http.Error(w, "assets horen bij een job-token", http.StatusBadRequest)
88 return
89 }
90 var assets []store.ReleaseAsset
91 for _, a := range req.Assets {
92 if a.Name == "" {
93 a.Name = filepath.Base(a.Path)
94 }
95 if err := names.ValidRepoName(strings.ReplaceAll(a.Name, ".", "x")); err != nil && strings.Contains(a.Name, "..") {
96 http.Error(w, "assetnaam", http.StatusBadRequest)
97 return
98 }
99 if strings.Contains(a.Name, "/") || strings.Contains(a.Name, "..") || a.Path == "" {
100 http.Error(w, "assetnaam", http.StatusBadRequest)
101 return
102 }
103 src, err := s.Store.ArtifactPath(r.Context(), job.PipelineID, a.Job, a.Path)
104 if err != nil {
105 http.Error(w, "artifact niet gevonden: "+a.Job+" "+a.Path, http.StatusBadRequest)
106 return
107 }
108 info, err := os.Stat(src)
109 if err != nil {
110 http.Error(w, "artifact ontbreekt op schijf", http.StatusBadRequest)
111 return
112 }
113 dst := filepath.Join(s.StoragePath(), "releases", repo.OwnerPath, repo.Name, req.Tag, a.Name)
114 if err := copyRelease(src, dst); err != nil {
115 http.Error(w, "asset kopiëren", http.StatusInternalServerError)
116 return
117 }
118 assets = append(assets, store.ReleaseAsset{Name: a.Name, StoragePath: dst, Size: info.Size()})
119 }
120 if err := gitrepo.Tag(r.Context(), s.Git, dir, req.Tag, req.Commit, req.Name); err != nil {
121 http.Error(w, "tag: "+err.Error(), http.StatusBadRequest)
122 return
123 }
124 id, err := s.Store.CreateRelease(r.Context(), repo.ID, req.Tag, req.Commit, req.Name, req.Body, author, job.ID, assets)
125 if err != nil {
126 http.Error(w, err.Error(), http.StatusBadRequest)
127 return
128 }
129 s.Dispatch(repo.ID, webhook.Event{
130 Type: webhook.EventRelease, Project: repo.FullPath(), Commit: req.Commit,
131 ReleaseTag: req.Tag, Summary: "release " + req.Tag + " van " + repo.FullPath() + " gepubliceerd",
132 URL: strings.TrimRight(s.Cfg.BaseURL, "/") + repoURL(repo) + "/-/releases",
133 })
134 w.Header().Set("Content-Type", "application/json")
135 w.WriteHeader(http.StatusCreated)
136 _ = json.NewEncoder(w).Encode(map[string]any{"id": id, "tag": req.Tag, "commit": req.Commit})
137}
138
139func (s *Server) releaseAsset(w http.ResponseWriter, r *http.Request) {
140 _, repo, _, ok := s.guard(w, r, access.RoleReadonly)
141 if !ok {
142 return
143 }
144 rel, err := s.Store.ReleaseByTag(r.Context(), repo.ID, r.PathValue("tag"))
145 if err != nil {
146 http.NotFound(w, r)
147 return
148 }
149 name := r.PathValue("name")
150 for _, a := range rel.Assets {
151 if a.Name == name {
152 w.Header().Set("Content-Disposition", "attachment; filename=\""+strings.ReplaceAll(name, "\"", "")+"\"")
153 http.ServeFile(w, r, a.StoragePath)
154 return
155 }
156 }
157 http.NotFound(w, r)
158}
159
160func bearer(r *http.Request) string {
161 h := r.Header.Get("Authorization")
162 if strings.HasPrefix(strings.ToLower(h), "bearer ") {
163 return strings.TrimSpace(h[7:])
164 }
165 return ""
166}
167
168func copyRelease(src, dst string) error {
169 if err := os.MkdirAll(filepath.Dir(dst), 0o755); err != nil {
170 return err
171 }
172 in, err := os.Open(src)
173 if err != nil {
174 return err
175 }
176 defer in.Close()
177 out, err := os.OpenFile(dst, os.O_CREATE|os.O_TRUNC|os.O_WRONLY, 0o644)
178 if err != nil {
179 return err
180 }
181 defer out.Close()
182 _, err = io.Copy(out, in)
183 return err
184}
internal/server/auth_handlers.go added +293 −0
@@ -0,0 +1,293 @@
1 package server
2
3 import (
4 "encoding/json"
5 "net/http"
6 "strings"
7 "time"
8
9 "gitlab.com/Timfa/bluegit/internal/access"
10 "golang.org/x/crypto/ssh"
11 )
12
13 func (s *Server) login(w http.ResponseWriter, r *http.Request) {
14 if s.who(r).OK {
15 http.Redirect(w, r, "/", http.StatusFound)
16 return
17 }
18 if s.Dev {
19 id, err := s.Auth.Exchange(r.Context(), "dev", s.Cfg.RedirectURI())
20 if err != nil {
21 http.Error(w, err.Error(), http.StatusBadGateway)
22 return
23 }
24 s.finishLogin(w, r, id.AuthID, id.Username, id.AvatarURL, id.IsAdmin, id.AccessToken, id.ExpiresIn)
25 return
26 }
27 state, err := randomState()
28 if err != nil {
29 http.Error(w, "sessie", http.StatusInternalServerError)
30 return
31 }
32 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
33 http.SetCookie(w, &http.Cookie{
34 Name: "bluegit_oauth_state", Value: state, Path: "/", MaxAge: 600,
35 HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode,
36 })
37 http.Redirect(w, r, s.Auth.AuthorizeURL(state, s.Cfg.RedirectURI()), http.StatusFound)
38 }
39
40 func (s *Server) callback(w http.ResponseWriter, r *http.Request) {
41 if s.Dev {
42 http.NotFound(w, r)
43 return
44 }
45 if msg := r.URL.Query().Get("error"); msg != "" {
46 s.redirect(w, r, "/login", "", "Aanmelden mislukt: "+msg)
47 return
48 }
49 stateCookie, err := r.Cookie("bluegit_oauth_state")
50 if err != nil || stateCookie.Value == "" || stateCookie.Value != r.URL.Query().Get("state") {
51 http.Error(w, "ongeldige aanmeldstatus", http.StatusBadRequest)
52 return
53 }
54 http.SetCookie(w, &http.Cookie{Name: "bluegit_oauth_state", Value: "", Path: "/", MaxAge: -1})
55 id, err := s.Auth.Exchange(r.Context(), r.URL.Query().Get("code"), s.Cfg.RedirectURI())
56 if err != nil {
57 s.Log.Error("oauth", "err", err)
58 s.redirect(w, r, "/", "", "Aanmelden is mislukt")
59 return
60 }
61 s.finishLogin(w, r, id.AuthID, id.Username, id.AvatarURL, id.IsAdmin, id.AccessToken, id.ExpiresIn)
62 }
63
64 func (s *Server) finishLogin(w http.ResponseWriter, r *http.Request, authID int64, username, avatar string, authAdmin bool, token string, expiresIn int) {
65 if expiresIn <= 0 {
66 expiresIn = 86400
67 }
68 user, err := s.Store.UpsertUser(r.Context(), authID, username, avatar, authAdmin)
69 if err != nil {
70 http.Error(w, err.Error(), http.StatusBadRequest)
71 return
72 }
73 exp := time.Now().Add(time.Duration(expiresIn) * time.Second)
74 sess, err := s.Store.CreateSession(r.Context(), user.ID, token, exp)
75 if err != nil {
76 http.Error(w, "sessie", http.StatusInternalServerError)
77 return
78 }
79 s.setSessionCookie(w, sess.ID, exp)
80 s.redirect(w, r, "/", "Welkom, "+user.Username, "")
81 }
82
83 func (s *Server) logout(w http.ResponseWriter, r *http.Request) {
84 if !s.csrfOK(w, r) {
85 return
86 }
87 p := s.who(r)
88 if p.OK {
89 _ = s.Auth.Logout(r.Context(), p.Session.AccessToken)
90 _ = s.Store.DeleteSession(r.Context(), p.Session.ID)
91 }
92 http.SetCookie(w, &http.Cookie{Name: "bluegit_session", Value: "", Path: "/", MaxAge: -1})
93 http.Redirect(w, r, "/", http.StatusSeeOther)
94 }
95
96 func (s *Server) home(w http.ResponseWriter, r *http.Request) {
97 v := s.view(w, r, "BlueGit")
98 if v.User != nil {
99 ids, err := s.Store.ListRepoIDs(r.Context(), v.User.ID)
100 if err != nil {
101 http.Error(w, "overzicht", http.StatusInternalServerError)
102 return
103 }
104 repos, err := s.Store.ReposByIDs(r.Context(), ids)
105 if err != nil {
106 http.Error(w, "overzicht", http.StatusInternalServerError)
107 return
108 }
109 v.Repos = repos
110 groups, err := s.Store.ListGroups(r.Context(), v.User.ID)
111 if err != nil {
112 http.Error(w, "overzicht", http.StatusInternalServerError)
113 return
114 }
115 v.Groups = groups
116 v.Title = "Overzicht"
117 s.render(w, "dashboard", v)
118 return
119 }
120 ids, err := s.Store.ListRepoIDs(r.Context(), 0)
121 if err == nil {
122 v.Repos, _ = s.Store.ReposByIDs(r.Context(), ids)
123 }
124 v.Title = ""
125 s.render(w, "home", v)
126 }
127
128 func (s *Server) newPage(w http.ResponseWriter, r *http.Request) {
129 if _, ok := s.loginRequired(w, r); !ok {
130 return
131 }
132 v := s.view(w, r, "Nieuw")
133 v.Groups, _ = s.Store.ListGroups(r.Context(), v.User.ID)
134 s.render(w, "new", v)
135 }
136
137 func (s *Server) account(w http.ResponseWriter, r *http.Request) {
138 u, ok := s.loginRequired(w, r)
139 if !ok {
140 return
141 }
142 v := s.view(w, r, "Account")
143 v.Tokens, _ = s.Store.ListTokens(r.Context(), u.ID)
144 v.Keys, _ = s.Store.ListSSHKeys(r.Context(), u.ID)
145 v.NewToken = cookieVal(r, "bluegit_token_once")
146 if v.NewToken != "" {
147 http.SetCookie(w, &http.Cookie{Name: "bluegit_token_once", Value: "", Path: "/", MaxAge: -1})
148 }
149 s.render(w, "account", v)
150 }
151
152 func (s *Server) createToken(w http.ResponseWriter, r *http.Request) {
153 u, ok := s.loginRequired(w, r)
154 if !ok || !s.csrfOK(w, r) {
155 return
156 }
157 plain, err := s.Store.CreateToken(r.Context(), u.ID, r.FormValue("name"))
158 if err != nil {
159 s.redirect(w, r, "/settings", "", err.Error())
160 return
161 }
162 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
163 http.SetCookie(w, &http.Cookie{Name: "bluegit_token_once", Value: plain, Path: "/settings", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
164 s.redirect(w, r, "/settings", "Token aangemaakt. Kopieer hem nu; hij wordt niet opnieuw getoond.", "")
165 }
166
167 func (s *Server) deleteToken(w http.ResponseWriter, r *http.Request) {
168 u, ok := s.loginRequired(w, r)
169 if !ok || !s.csrfOK(w, r) {
170 return
171 }
172 var id int64
173 _, _ = parseID(r.FormValue("id"), &id)
174 if err := s.Store.DeleteToken(r.Context(), u.ID, id); err != nil {
175 s.redirect(w, r, "/settings", "", "token niet gevonden")
176 return
177 }
178 s.redirect(w, r, "/settings", "Token ingetrokken", "")
179 }
180
181 func (s *Server) addSSH(w http.ResponseWriter, r *http.Request) {
182 u, ok := s.loginRequired(w, r)
183 if !ok || !s.csrfOK(w, r) {
184 return
185 }
186 line := strings.TrimSpace(r.FormValue("key"))
187 pub, _, _, _, err := ssh.ParseAuthorizedKey([]byte(line))
188 if err != nil {
189 s.redirect(w, r, "/settings", "", "dat is geen OpenSSH-publieke sleutel")
190 return
191 }
192 stored := strings.TrimSpace(string(ssh.MarshalAuthorizedKey(pub)))
193 fp := ssh.FingerprintSHA256(pub)
194 if err := s.Store.AddSSHKey(r.Context(), u.ID, r.FormValue("name"), stored, fp); err != nil {
195 s.redirect(w, r, "/settings", "", err.Error())
196 return
197 }
198 s.redirect(w, r, "/settings", "Sleutel toegevoegd", "")
199 }
200
201 func (s *Server) deleteSSH(w http.ResponseWriter, r *http.Request) {
202 u, ok := s.loginRequired(w, r)
203 if !ok || !s.csrfOK(w, r) {
204 return
205 }
206 var id int64
207 _, _ = parseID(r.FormValue("id"), &id)
208 if err := s.Store.DeleteSSHKey(r.Context(), u.ID, id); err != nil {
209 s.redirect(w, r, "/settings", "", "sleutel niet gevonden")
210 return
211 }
212 s.redirect(w, r, "/settings", "Sleutel verwijderd", "")
213 }
214
215 func (s *Server) export(w http.ResponseWriter, r *http.Request) {
216 u, ok := s.loginRequired(w, r)
217 if !ok {
218 return
219 }
220 type secretRow struct {
221 Scope string `json:"scope"`
222 Name string `json:"name"`
223 Value string `json:"value"`
224 }
225 var secrets []secretRow
226 ids, _ := s.Store.ListRepoIDs(r.Context(), u.ID)
227 for _, id := range ids {
228 role, err := s.Store.EffectiveRole(r.Context(), u.ID, id)
229 if err != nil || !role.CanManageSecrets() {
230 continue
231 }
232 repo, err := s.Store.RepoByID(r.Context(), id)
233 if err != nil {
234 continue
235 }
236 vals, err := s.Store.SecretValues(r.Context(), "repo", id, true)
237 if err != nil {
238 continue
239 }
240 for name, value := range vals {
241 secrets = append(secrets, secretRow{Scope: "repo:" + repo.FullPath(), Name: name, Value: value})
242 }
243 }
244 groups, _ := s.Store.ListGroups(r.Context(), u.ID)
245 for _, g := range groups {
246 role, err := s.Store.GroupRole(r.Context(), g.ID, u.ID)
247 if err != nil || !role.AtLeast(access.RoleMaintainer) {
248 continue
249 }
250 vals, err := s.Store.SecretValues(r.Context(), "group", g.ID, true)
251 if err != nil {
252 continue
253 }
254 for name, value := range vals {
255 secrets = append(secrets, secretRow{Scope: "group:" + g.Path, Name: name, Value: value})
256 }
257 }
258 tokens, _ := s.Store.ListTokens(r.Context(), u.ID)
259 keys, _ := s.Store.ListSSHKeys(r.Context(), u.ID)
260 payload := map[string]any{
261 "exported_at": time.Now().UTC().Format(time.RFC3339),
262 "account": map[string]any{
263 "id": u.AuthID,
264 "username": u.Username,
265 "avatar_url": u.AvatarURL,
266 "instance_admin": u.InstanceAdmin,
267 },
268 "tokens": tokens,
269 "ssh_keys": keys,
270 "secrets": secrets,
271 }
272 w.Header().Set("Content-Type", "application/json; charset=utf-8")
273 w.Header().Set("Content-Disposition", `attachment; filename="bluegit-export.json"`)
274 enc := json.NewEncoder(w)
275 enc.SetIndent("", " ")
276 _ = enc.Encode(payload)
277 }
278
279 func parseID(s string, dest *int64) (int64, error) {
280 var n int64
281 for _, c := range s {
282 if c < '0' || c > '9' {
283 return 0, errBadID
284 }
285 n = n*10 + int64(c-'0')
286 }
287 if dest != nil {
288 *dest = n
289 }
290 return n, nil
291 }
292
293 var errBadID = http.ErrMissingFile
@@ -0,0 +1,293 @@
1package server
2
3import (
4 "encoding/json"
5 "net/http"
6 "strings"
7 "time"
8
9 "gitlab.com/Timfa/bluegit/internal/access"
10 "golang.org/x/crypto/ssh"
11)
12
13func (s *Server) login(w http.ResponseWriter, r *http.Request) {
14 if s.who(r).OK {
15 http.Redirect(w, r, "/", http.StatusFound)
16 return
17 }
18 if s.Dev {
19 id, err := s.Auth.Exchange(r.Context(), "dev", s.Cfg.RedirectURI())
20 if err != nil {
21 http.Error(w, err.Error(), http.StatusBadGateway)
22 return
23 }
24 s.finishLogin(w, r, id.AuthID, id.Username, id.AvatarURL, id.IsAdmin, id.AccessToken, id.ExpiresIn)
25 return
26 }
27 state, err := randomState()
28 if err != nil {
29 http.Error(w, "sessie", http.StatusInternalServerError)
30 return
31 }
32 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
33 http.SetCookie(w, &http.Cookie{
34 Name: "bluegit_oauth_state", Value: state, Path: "/", MaxAge: 600,
35 HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode,
36 })
37 http.Redirect(w, r, s.Auth.AuthorizeURL(state, s.Cfg.RedirectURI()), http.StatusFound)
38}
39
40func (s *Server) callback(w http.ResponseWriter, r *http.Request) {
41 if s.Dev {
42 http.NotFound(w, r)
43 return
44 }
45 if msg := r.URL.Query().Get("error"); msg != "" {
46 s.redirect(w, r, "/login", "", "Aanmelden mislukt: "+msg)
47 return
48 }
49 stateCookie, err := r.Cookie("bluegit_oauth_state")
50 if err != nil || stateCookie.Value == "" || stateCookie.Value != r.URL.Query().Get("state") {
51 http.Error(w, "ongeldige aanmeldstatus", http.StatusBadRequest)
52 return
53 }
54 http.SetCookie(w, &http.Cookie{Name: "bluegit_oauth_state", Value: "", Path: "/", MaxAge: -1})
55 id, err := s.Auth.Exchange(r.Context(), r.URL.Query().Get("code"), s.Cfg.RedirectURI())
56 if err != nil {
57 s.Log.Error("oauth", "err", err)
58 s.redirect(w, r, "/", "", "Aanmelden is mislukt")
59 return
60 }
61 s.finishLogin(w, r, id.AuthID, id.Username, id.AvatarURL, id.IsAdmin, id.AccessToken, id.ExpiresIn)
62}
63
64func (s *Server) finishLogin(w http.ResponseWriter, r *http.Request, authID int64, username, avatar string, authAdmin bool, token string, expiresIn int) {
65 if expiresIn <= 0 {
66 expiresIn = 86400
67 }
68 user, err := s.Store.UpsertUser(r.Context(), authID, username, avatar, authAdmin)
69 if err != nil {
70 http.Error(w, err.Error(), http.StatusBadRequest)
71 return
72 }
73 exp := time.Now().Add(time.Duration(expiresIn) * time.Second)
74 sess, err := s.Store.CreateSession(r.Context(), user.ID, token, exp)
75 if err != nil {
76 http.Error(w, "sessie", http.StatusInternalServerError)
77 return
78 }
79 s.setSessionCookie(w, sess.ID, exp)
80 s.redirect(w, r, "/", "Welkom, "+user.Username, "")
81}
82
83func (s *Server) logout(w http.ResponseWriter, r *http.Request) {
84 if !s.csrfOK(w, r) {
85 return
86 }
87 p := s.who(r)
88 if p.OK {
89 _ = s.Auth.Logout(r.Context(), p.Session.AccessToken)
90 _ = s.Store.DeleteSession(r.Context(), p.Session.ID)
91 }
92 http.SetCookie(w, &http.Cookie{Name: "bluegit_session", Value: "", Path: "/", MaxAge: -1})
93 http.Redirect(w, r, "/", http.StatusSeeOther)
94}
95
96func (s *Server) home(w http.ResponseWriter, r *http.Request) {
97 v := s.view(w, r, "BlueGit")
98 if v.User != nil {
99 ids, err := s.Store.ListRepoIDs(r.Context(), v.User.ID)
100 if err != nil {
101 http.Error(w, "overzicht", http.StatusInternalServerError)
102 return
103 }
104 repos, err := s.Store.ReposByIDs(r.Context(), ids)
105 if err != nil {
106 http.Error(w, "overzicht", http.StatusInternalServerError)
107 return
108 }
109 v.Repos = repos
110 groups, err := s.Store.ListGroups(r.Context(), v.User.ID)
111 if err != nil {
112 http.Error(w, "overzicht", http.StatusInternalServerError)
113 return
114 }
115 v.Groups = groups
116 v.Title = "Overzicht"
117 s.render(w, "dashboard", v)
118 return
119 }
120 ids, err := s.Store.ListRepoIDs(r.Context(), 0)
121 if err == nil {
122 v.Repos, _ = s.Store.ReposByIDs(r.Context(), ids)
123 }
124 v.Title = ""
125 s.render(w, "home", v)
126}
127
128func (s *Server) newPage(w http.ResponseWriter, r *http.Request) {
129 if _, ok := s.loginRequired(w, r); !ok {
130 return
131 }
132 v := s.view(w, r, "Nieuw")
133 v.Groups, _ = s.Store.ListGroups(r.Context(), v.User.ID)
134 s.render(w, "new", v)
135}
136
137func (s *Server) account(w http.ResponseWriter, r *http.Request) {
138 u, ok := s.loginRequired(w, r)
139 if !ok {
140 return
141 }
142 v := s.view(w, r, "Account")
143 v.Tokens, _ = s.Store.ListTokens(r.Context(), u.ID)
144 v.Keys, _ = s.Store.ListSSHKeys(r.Context(), u.ID)
145 v.NewToken = cookieVal(r, "bluegit_token_once")
146 if v.NewToken != "" {
147 http.SetCookie(w, &http.Cookie{Name: "bluegit_token_once", Value: "", Path: "/", MaxAge: -1})
148 }
149 s.render(w, "account", v)
150}
151
152func (s *Server) createToken(w http.ResponseWriter, r *http.Request) {
153 u, ok := s.loginRequired(w, r)
154 if !ok || !s.csrfOK(w, r) {
155 return
156 }
157 plain, err := s.Store.CreateToken(r.Context(), u.ID, r.FormValue("name"))
158 if err != nil {
159 s.redirect(w, r, "/settings", "", err.Error())
160 return
161 }
162 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
163 http.SetCookie(w, &http.Cookie{Name: "bluegit_token_once", Value: plain, Path: "/settings", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
164 s.redirect(w, r, "/settings", "Token aangemaakt. Kopieer hem nu; hij wordt niet opnieuw getoond.", "")
165}
166
167func (s *Server) deleteToken(w http.ResponseWriter, r *http.Request) {
168 u, ok := s.loginRequired(w, r)
169 if !ok || !s.csrfOK(w, r) {
170 return
171 }
172 var id int64
173 _, _ = parseID(r.FormValue("id"), &id)
174 if err := s.Store.DeleteToken(r.Context(), u.ID, id); err != nil {
175 s.redirect(w, r, "/settings", "", "token niet gevonden")
176 return
177 }
178 s.redirect(w, r, "/settings", "Token ingetrokken", "")
179}
180
181func (s *Server) addSSH(w http.ResponseWriter, r *http.Request) {
182 u, ok := s.loginRequired(w, r)
183 if !ok || !s.csrfOK(w, r) {
184 return
185 }
186 line := strings.TrimSpace(r.FormValue("key"))
187 pub, _, _, _, err := ssh.ParseAuthorizedKey([]byte(line))
188 if err != nil {
189 s.redirect(w, r, "/settings", "", "dat is geen OpenSSH-publieke sleutel")
190 return
191 }
192 stored := strings.TrimSpace(string(ssh.MarshalAuthorizedKey(pub)))
193 fp := ssh.FingerprintSHA256(pub)
194 if err := s.Store.AddSSHKey(r.Context(), u.ID, r.FormValue("name"), stored, fp); err != nil {
195 s.redirect(w, r, "/settings", "", err.Error())
196 return
197 }
198 s.redirect(w, r, "/settings", "Sleutel toegevoegd", "")
199}
200
201func (s *Server) deleteSSH(w http.ResponseWriter, r *http.Request) {
202 u, ok := s.loginRequired(w, r)
203 if !ok || !s.csrfOK(w, r) {
204 return
205 }
206 var id int64
207 _, _ = parseID(r.FormValue("id"), &id)
208 if err := s.Store.DeleteSSHKey(r.Context(), u.ID, id); err != nil {
209 s.redirect(w, r, "/settings", "", "sleutel niet gevonden")
210 return
211 }
212 s.redirect(w, r, "/settings", "Sleutel verwijderd", "")
213}
214
215func (s *Server) export(w http.ResponseWriter, r *http.Request) {
216 u, ok := s.loginRequired(w, r)
217 if !ok {
218 return
219 }
220 type secretRow struct {
221 Scope string `json:"scope"`
222 Name string `json:"name"`
223 Value string `json:"value"`
224 }
225 var secrets []secretRow
226 ids, _ := s.Store.ListRepoIDs(r.Context(), u.ID)
227 for _, id := range ids {
228 role, err := s.Store.EffectiveRole(r.Context(), u.ID, id)
229 if err != nil || !role.CanManageSecrets() {
230 continue
231 }
232 repo, err := s.Store.RepoByID(r.Context(), id)
233 if err != nil {
234 continue
235 }
236 vals, err := s.Store.SecretValues(r.Context(), "repo", id, true)
237 if err != nil {
238 continue
239 }
240 for name, value := range vals {
241 secrets = append(secrets, secretRow{Scope: "repo:" + repo.FullPath(), Name: name, Value: value})
242 }
243 }
244 groups, _ := s.Store.ListGroups(r.Context(), u.ID)
245 for _, g := range groups {
246 role, err := s.Store.GroupRole(r.Context(), g.ID, u.ID)
247 if err != nil || !role.AtLeast(access.RoleMaintainer) {
248 continue
249 }
250 vals, err := s.Store.SecretValues(r.Context(), "group", g.ID, true)
251 if err != nil {
252 continue
253 }
254 for name, value := range vals {
255 secrets = append(secrets, secretRow{Scope: "group:" + g.Path, Name: name, Value: value})
256 }
257 }
258 tokens, _ := s.Store.ListTokens(r.Context(), u.ID)
259 keys, _ := s.Store.ListSSHKeys(r.Context(), u.ID)
260 payload := map[string]any{
261 "exported_at": time.Now().UTC().Format(time.RFC3339),
262 "account": map[string]any{
263 "id": u.AuthID,
264 "username": u.Username,
265 "avatar_url": u.AvatarURL,
266 "instance_admin": u.InstanceAdmin,
267 },
268 "tokens": tokens,
269 "ssh_keys": keys,
270 "secrets": secrets,
271 }
272 w.Header().Set("Content-Type", "application/json; charset=utf-8")
273 w.Header().Set("Content-Disposition", `attachment; filename="bluegit-export.json"`)
274 enc := json.NewEncoder(w)
275 enc.SetIndent("", " ")
276 _ = enc.Encode(payload)
277}
278
279func parseID(s string, dest *int64) (int64, error) {
280 var n int64
281 for _, c := range s {
282 if c < '0' || c > '9' {
283 return 0, errBadID
284 }
285 n = n*10 + int64(c-'0')
286 }
287 if dest != nil {
288 *dest = n
289 }
290 return n, nil
291}
292
293var errBadID = http.ErrMissingFile
internal/server/events.go added +225 −0
@@ -0,0 +1,225 @@
1 package server
2
3 import (
4 "bytes"
5 "context"
6 "fmt"
7 "io"
8 "net/http"
9 "net/url"
10 "os/exec"
11 "strings"
12 "time"
13
14 "gitlab.com/Timfa/bluegit/internal/access"
15 "gitlab.com/Timfa/bluegit/internal/ci"
16 "gitlab.com/Timfa/bluegit/internal/gitrepo"
17 "gitlab.com/Timfa/bluegit/internal/ssrf"
18 "gitlab.com/Timfa/bluegit/internal/store"
19 "gitlab.com/Timfa/bluegit/internal/webhook"
20 )
21
22 func (s *Server) AfterPush(repo store.Repo, user store.User, before, after map[string]string) {
23 if after == nil {
24 return
25 }
26 actor := user.Username
27 for ref, sha := range after {
28 if before[ref] == sha {
29 continue
30 }
31 branch, ok := gitrepo.BranchOfRef(ref)
32 if !ok || isZero(sha) {
33 continue
34 }
35 s.startPipeline(context.Background(), repo, sha, ref, actor)
36 web := strings.TrimRight(s.Cfg.BaseURL, "/") + "/" + repo.FullPath()
37 s.Dispatch(repo.ID, webhook.Event{
38 Type: webhook.EventPush,
39 Project: repo.FullPath(),
40 Branch: branch,
41 Commit: sha,
42 Summary: fmt.Sprintf("%s pushte naar %s in %s", actor, branch, repo.FullPath()),
43 URL: web,
44 Actor: actor,
45 })
46 }
47 }
48
49 func isZero(sha string) bool {
50 return strings.Trim(sha, "0") == ""
51 }
52
53 func (s *Server) startPipeline(ctx context.Context, repo store.Repo, sha, ref, actor string) {
54 if !s.Cfg.CI.Enabled || s.StoragePath() == "" {
55 return
56 }
57 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
58 raw, err := exec.CommandContext(ctx, s.Git, "-C", dir, "show", sha+":blue-ci-cd.yml").Output()
59 if err != nil {
60 return
61 }
62 spec, err := ci.Parse(raw)
63 branch, _ := gitrepo.BranchOfRef(ref)
64 if branch == "" {
65 branch = ref
66 }
67 if err != nil {
68 _ = s.Store.RecordConfigFailure(ctx, repo.ID, sha, ref, "blue-ci-cd.yml: "+err.Error())
69 return
70 }
71 env := map[string]string{"CI_COMMIT_BRANCH": branch, "CI_COMMIT_SHA": sha, "CI_COMMIT_REF": ref}
72 active, err := spec.ActiveJobs(env)
73 if err != nil {
74 _ = s.Store.RecordConfigFailure(ctx, repo.ID, sha, ref, err.Error())
75 return
76 }
77 if len(active) == 0 {
78 return
79 }
80 var jobs []store.NewJob
81 for i, j := range active {
82 vars := map[string]string{}
83 for k, v := range spec.Variables {
84 vars[k] = v
85 }
86 for k, v := range j.Variables {
87 vars[k] = v
88 }
89 needs := j.Needs
90 if needs == nil {
91 needs = []string{}
92 }
93 paths := j.Artifacts.Paths
94 if paths == nil {
95 paths = []string{}
96 }
97 jobs = append(jobs, store.NewJob{
98 Name: j.Name, Stage: j.Stage, Position: i, Image: j.Image,
99 Script: strings.Join(j.Script, "\n"), Needs: needs, NeedsSet: j.NeedsSet,
100 Variables: vars, ArtifactPaths: paths, ArtifactExpire: j.Artifacts.ExpireIn,
101 AllowFailure: j.AllowFailure,
102 })
103 }
104 if _, err := s.Store.CreatePipeline(ctx, repo.ID, sha, ref, jobs); err != nil && s.Log != nil {
105 s.Log.Error("pipeline", "err", err)
106 }
107 _ = actor
108 }
109
110 func pushEvent(repo store.Repo, kind, branch, commit, actor, summary, path string) webhook.Event {
111 return webhook.Event{
112 Type: kind, Project: repo.FullPath(), Branch: branch, Commit: commit,
113 Actor: actor, Summary: summary, URL: path,
114 }
115 }
116
117 func (s *Server) Dispatch(repoID int64, ev webhook.Event) {
118 ctx := context.Background()
119 repo, err := s.Store.RepoByID(ctx, repoID)
120 if err != nil {
121 return
122 }
123 if ev.Project == "" {
124 ev.Project = repo.FullPath()
125 }
126 if !strings.HasPrefix(ev.URL, "http") {
127 ev.URL = strings.TrimRight(s.Cfg.BaseURL, "/") + ev.URL
128 }
129 if repo.OwnerKind == "group" {
130 if g, err := s.Store.GroupByID(ctx, repo.OwnerID); err == nil {
131 ev.Group = g.Path
132 }
133 }
134 patterns, _ := s.Store.ProtectedPatterns(ctx, repo.ID)
135 protected := access.BranchProtected(patterns, ev.Branch)
136 s.deliver(ctx, "repo", repo.ID, ev, protected)
137 if repo.OwnerKind == "group" {
138 s.deliver(ctx, "group", repo.OwnerID, ev, protected)
139 }
140 }
141
142 func (s *Server) deliver(ctx context.Context, kind string, scopeID int64, ev webhook.Event, refProtected bool) {
143 hooks, err := s.Store.ListWebhooks(ctx, kind, scopeID)
144 if err != nil {
145 return
146 }
147 secrets, err := s.Store.SecretValues(ctx, kind, scopeID, refProtected)
148 if err != nil {
149 s.Log.Error("geheimen voor webhook", "err", err)
150 return
151 }
152 client := ssrf.NewClient(10 * time.Second)
153 for _, h := range hooks {
154 if !h.Active {
155 continue
156 }
157 ok, err := webhook.Allows(webhook.Hook{Preset: h.Preset, Events: h.Events, BranchFilter: h.BranchFilter}, ev)
158 if err != nil {
159 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
160 continue
161 }
162 if !ok {
163 continue
164 }
165 rawURL, err := webhook.Expand(h.URLTemplate, ev, secrets)
166 if err != nil {
167 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
168 continue
169 }
170 target, err := urlParse(rawURL)
171 if err != nil {
172 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
173 continue
174 }
175 if err := ssrf.ValidateURL(target); err != nil {
176 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
177 continue
178 }
179 headers, err := webhook.RenderHeaders(h.Preset, h.Headers, ev, secrets)
180 if err != nil {
181 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
182 continue
183 }
184 body, err := webhook.RenderBody(h.BodyTemplate, ev, secrets)
185 if err != nil {
186 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
187 continue
188 }
189 req, err := http.NewRequestWithContext(ctx, http.MethodPost, rawURL, bytes.NewReader(body))
190 if err != nil {
191 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
192 continue
193 }
194 for k, v := range headers {
195 if strings.ContainsAny(k, "\r\n") || strings.ContainsAny(v, "\r\n") {
196 continue
197 }
198 req.Header.Set(k, v)
199 }
200 res, err := client.Do(req)
201 if err != nil {
202 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
203 continue
204 }
205 _, _ = io.Copy(io.Discard, io.LimitReader(res.Body, 1<<20))
206 res.Body.Close()
207 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, res.StatusCode, "")
208 }
209 }
210
211 func urlParse(raw string) (*url.URL, error) {
212 u, err := url.Parse(raw)
213 if err != nil {
214 return nil, fmt.Errorf("webhook-URL is ongeldig")
215 }
216 return u, nil
217 }
218
219 func gitSHA(r *http.Request, gitBin, dir, rev string) (string, error) {
220 out, err := exec.CommandContext(r.Context(), gitBin, "-C", dir, "rev-parse", "--verify", rev+"^{commit}").Output()
221 if err != nil {
222 return "", err
223 }
224 return strings.TrimSpace(string(out)), nil
225 }
@@ -0,0 +1,225 @@
1package server
2
3import (
4 "bytes"
5 "context"
6 "fmt"
7 "io"
8 "net/http"
9 "net/url"
10 "os/exec"
11 "strings"
12 "time"
13
14 "gitlab.com/Timfa/bluegit/internal/access"
15 "gitlab.com/Timfa/bluegit/internal/ci"
16 "gitlab.com/Timfa/bluegit/internal/gitrepo"
17 "gitlab.com/Timfa/bluegit/internal/ssrf"
18 "gitlab.com/Timfa/bluegit/internal/store"
19 "gitlab.com/Timfa/bluegit/internal/webhook"
20)
21
22func (s *Server) AfterPush(repo store.Repo, user store.User, before, after map[string]string) {
23 if after == nil {
24 return
25 }
26 actor := user.Username
27 for ref, sha := range after {
28 if before[ref] == sha {
29 continue
30 }
31 branch, ok := gitrepo.BranchOfRef(ref)
32 if !ok || isZero(sha) {
33 continue
34 }
35 s.startPipeline(context.Background(), repo, sha, ref, actor)
36 web := strings.TrimRight(s.Cfg.BaseURL, "/") + "/" + repo.FullPath()
37 s.Dispatch(repo.ID, webhook.Event{
38 Type: webhook.EventPush,
39 Project: repo.FullPath(),
40 Branch: branch,
41 Commit: sha,
42 Summary: fmt.Sprintf("%s pushte naar %s in %s", actor, branch, repo.FullPath()),
43 URL: web,
44 Actor: actor,
45 })
46 }
47}
48
49func isZero(sha string) bool {
50 return strings.Trim(sha, "0") == ""
51}
52
53func (s *Server) startPipeline(ctx context.Context, repo store.Repo, sha, ref, actor string) {
54 if !s.Cfg.CI.Enabled || s.StoragePath() == "" {
55 return
56 }
57 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
58 raw, err := exec.CommandContext(ctx, s.Git, "-C", dir, "show", sha+":blue-ci-cd.yml").Output()
59 if err != nil {
60 return
61 }
62 spec, err := ci.Parse(raw)
63 branch, _ := gitrepo.BranchOfRef(ref)
64 if branch == "" {
65 branch = ref
66 }
67 if err != nil {
68 _ = s.Store.RecordConfigFailure(ctx, repo.ID, sha, ref, "blue-ci-cd.yml: "+err.Error())
69 return
70 }
71 env := map[string]string{"CI_COMMIT_BRANCH": branch, "CI_COMMIT_SHA": sha, "CI_COMMIT_REF": ref}
72 active, err := spec.ActiveJobs(env)
73 if err != nil {
74 _ = s.Store.RecordConfigFailure(ctx, repo.ID, sha, ref, err.Error())
75 return
76 }
77 if len(active) == 0 {
78 return
79 }
80 var jobs []store.NewJob
81 for i, j := range active {
82 vars := map[string]string{}
83 for k, v := range spec.Variables {
84 vars[k] = v
85 }
86 for k, v := range j.Variables {
87 vars[k] = v
88 }
89 needs := j.Needs
90 if needs == nil {
91 needs = []string{}
92 }
93 paths := j.Artifacts.Paths
94 if paths == nil {
95 paths = []string{}
96 }
97 jobs = append(jobs, store.NewJob{
98 Name: j.Name, Stage: j.Stage, Position: i, Image: j.Image,
99 Script: strings.Join(j.Script, "\n"), Needs: needs, NeedsSet: j.NeedsSet,
100 Variables: vars, ArtifactPaths: paths, ArtifactExpire: j.Artifacts.ExpireIn,
101 AllowFailure: j.AllowFailure,
102 })
103 }
104 if _, err := s.Store.CreatePipeline(ctx, repo.ID, sha, ref, jobs); err != nil && s.Log != nil {
105 s.Log.Error("pipeline", "err", err)
106 }
107 _ = actor
108}
109
110func pushEvent(repo store.Repo, kind, branch, commit, actor, summary, path string) webhook.Event {
111 return webhook.Event{
112 Type: kind, Project: repo.FullPath(), Branch: branch, Commit: commit,
113 Actor: actor, Summary: summary, URL: path,
114 }
115}
116
117func (s *Server) Dispatch(repoID int64, ev webhook.Event) {
118 ctx := context.Background()
119 repo, err := s.Store.RepoByID(ctx, repoID)
120 if err != nil {
121 return
122 }
123 if ev.Project == "" {
124 ev.Project = repo.FullPath()
125 }
126 if !strings.HasPrefix(ev.URL, "http") {
127 ev.URL = strings.TrimRight(s.Cfg.BaseURL, "/") + ev.URL
128 }
129 if repo.OwnerKind == "group" {
130 if g, err := s.Store.GroupByID(ctx, repo.OwnerID); err == nil {
131 ev.Group = g.Path
132 }
133 }
134 patterns, _ := s.Store.ProtectedPatterns(ctx, repo.ID)
135 protected := access.BranchProtected(patterns, ev.Branch)
136 s.deliver(ctx, "repo", repo.ID, ev, protected)
137 if repo.OwnerKind == "group" {
138 s.deliver(ctx, "group", repo.OwnerID, ev, protected)
139 }
140}
141
142func (s *Server) deliver(ctx context.Context, kind string, scopeID int64, ev webhook.Event, refProtected bool) {
143 hooks, err := s.Store.ListWebhooks(ctx, kind, scopeID)
144 if err != nil {
145 return
146 }
147 secrets, err := s.Store.SecretValues(ctx, kind, scopeID, refProtected)
148 if err != nil {
149 s.Log.Error("geheimen voor webhook", "err", err)
150 return
151 }
152 client := ssrf.NewClient(10 * time.Second)
153 for _, h := range hooks {
154 if !h.Active {
155 continue
156 }
157 ok, err := webhook.Allows(webhook.Hook{Preset: h.Preset, Events: h.Events, BranchFilter: h.BranchFilter}, ev)
158 if err != nil {
159 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
160 continue
161 }
162 if !ok {
163 continue
164 }
165 rawURL, err := webhook.Expand(h.URLTemplate, ev, secrets)
166 if err != nil {
167 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
168 continue
169 }
170 target, err := urlParse(rawURL)
171 if err != nil {
172 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
173 continue
174 }
175 if err := ssrf.ValidateURL(target); err != nil {
176 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
177 continue
178 }
179 headers, err := webhook.RenderHeaders(h.Preset, h.Headers, ev, secrets)
180 if err != nil {
181 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
182 continue
183 }
184 body, err := webhook.RenderBody(h.BodyTemplate, ev, secrets)
185 if err != nil {
186 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
187 continue
188 }
189 req, err := http.NewRequestWithContext(ctx, http.MethodPost, rawURL, bytes.NewReader(body))
190 if err != nil {
191 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
192 continue
193 }
194 for k, v := range headers {
195 if strings.ContainsAny(k, "\r\n") || strings.ContainsAny(v, "\r\n") {
196 continue
197 }
198 req.Header.Set(k, v)
199 }
200 res, err := client.Do(req)
201 if err != nil {
202 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, 0, err.Error())
203 continue
204 }
205 _, _ = io.Copy(io.Discard, io.LimitReader(res.Body, 1<<20))
206 res.Body.Close()
207 _ = s.Store.AddDelivery(ctx, h.ID, ev.Type, res.StatusCode, "")
208 }
209}
210
211func urlParse(raw string) (*url.URL, error) {
212 u, err := url.Parse(raw)
213 if err != nil {
214 return nil, fmt.Errorf("webhook-URL is ongeldig")
215 }
216 return u, nil
217}
218
219func gitSHA(r *http.Request, gitBin, dir, rev string) (string, error) {
220 out, err := exec.CommandContext(r.Context(), gitBin, "-C", dir, "rev-parse", "--verify", rev+"^{commit}").Output()
221 if err != nil {
222 return "", err
223 }
224 return strings.TrimSpace(string(out)), nil
225}
internal/server/git_http.go added +97 −0
@@ -0,0 +1,97 @@
1 package server
2
3 import (
4 "net/http"
5 "strings"
6
7 "gitlab.com/Timfa/bluegit/internal/access"
8 "gitlab.com/Timfa/bluegit/internal/gitrepo"
9 "gitlab.com/Timfa/bluegit/internal/store"
10 )
11
12 func (s *Server) gitHTTP(w http.ResponseWriter, r *http.Request) {
13 if s.StoragePath() == "" {
14 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
15 return
16 }
17 owner := r.PathValue("owner")
18 repoSeg := r.PathValue("repo")
19 if !strings.HasSuffix(repoSeg, ".git") {
20 http.NotFound(w, r)
21 return
22 }
23 name := strings.TrimSuffix(repoSeg, ".git")
24 repo, err := s.Store.RepoByPath(r.Context(), owner, name)
25 if err != nil {
26 http.NotFound(w, r)
27 return
28 }
29 service := r.URL.Query().Get("service")
30 write := service == "git-receive-pack" || strings.HasSuffix(r.URL.Path, "/git-receive-pack")
31 user, authed := s.gitUser(r)
32 var role access.Role
33 if authed {
34 role, err = s.Store.EffectiveRole(r.Context(), user.ID, repo.ID)
35 if err != nil {
36 http.Error(w, "rechten", http.StatusInternalServerError)
37 return
38 }
39 }
40 if write {
41 if !authed {
42 s.askAuth(w)
43 return
44 }
45 if !role.CanWriteCode() {
46 http.Error(w, "geen schrijfrechten", http.StatusForbidden)
47 return
48 }
49 } else if !role.CanRead() && repo.Visibility != "public" {
50 if !authed {
51 s.askAuth(w)
52 return
53 }
54 http.Error(w, "geen leesrechten", http.StatusForbidden)
55 return
56 }
57 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
58 var before map[string]string
59 var extra []string
60 if write {
61 before, _ = gitrepo.Refs(r.Context(), s.Git, dir)
62 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
63 extra = gitrepo.PushEnv(role, patterns)
64 }
65 rest := strings.TrimPrefix(r.URL.Path, "/"+owner+"/"+repoSeg)
66 pathInfo := gitrepo.PathInfo(owner, repoSeg, rest)
67 if err := gitrepo.ServeSmartHTTP(w, r, s.Git, gitrepo.ProjectRoot(s.StoragePath()), pathInfo, extra); err != nil && s.Log != nil {
68 s.Log.Error("git http", "err", err, "path", r.URL.Path)
69 }
70 if write {
71 after, err := gitrepo.Refs(r.Context(), s.Git, dir)
72 if err == nil {
73 s.AfterPush(repo, user, before, after)
74 }
75 }
76 }
77
78 func (s *Server) gitUser(r *http.Request) (store.User, bool) {
79 _, pass, ok := r.BasicAuth()
80 if !ok {
81 h := r.Header.Get("Authorization")
82 if strings.HasPrefix(strings.ToLower(h), "bearer ") {
83 pass = strings.TrimSpace(h[7:])
84 ok = pass != ""
85 }
86 }
87 if !ok || !strings.HasPrefix(pass, "bg_") {
88 return store.User{}, false
89 }
90 u, err := s.Store.UserByToken(r.Context(), pass)
91 return u, err == nil
92 }
93
94 func (s *Server) askAuth(w http.ResponseWriter) {
95 w.Header().Set("WWW-Authenticate", `Basic realm="BlueGit"`)
96 http.Error(w, "aanmelden met een toegangstoken als wachtwoord", http.StatusUnauthorized)
97 }
@@ -0,0 +1,97 @@
1package server
2
3import (
4 "net/http"
5 "strings"
6
7 "gitlab.com/Timfa/bluegit/internal/access"
8 "gitlab.com/Timfa/bluegit/internal/gitrepo"
9 "gitlab.com/Timfa/bluegit/internal/store"
10)
11
12func (s *Server) gitHTTP(w http.ResponseWriter, r *http.Request) {
13 if s.StoragePath() == "" {
14 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
15 return
16 }
17 owner := r.PathValue("owner")
18 repoSeg := r.PathValue("repo")
19 if !strings.HasSuffix(repoSeg, ".git") {
20 http.NotFound(w, r)
21 return
22 }
23 name := strings.TrimSuffix(repoSeg, ".git")
24 repo, err := s.Store.RepoByPath(r.Context(), owner, name)
25 if err != nil {
26 http.NotFound(w, r)
27 return
28 }
29 service := r.URL.Query().Get("service")
30 write := service == "git-receive-pack" || strings.HasSuffix(r.URL.Path, "/git-receive-pack")
31 user, authed := s.gitUser(r)
32 var role access.Role
33 if authed {
34 role, err = s.Store.EffectiveRole(r.Context(), user.ID, repo.ID)
35 if err != nil {
36 http.Error(w, "rechten", http.StatusInternalServerError)
37 return
38 }
39 }
40 if write {
41 if !authed {
42 s.askAuth(w)
43 return
44 }
45 if !role.CanWriteCode() {
46 http.Error(w, "geen schrijfrechten", http.StatusForbidden)
47 return
48 }
49 } else if !role.CanRead() && repo.Visibility != "public" {
50 if !authed {
51 s.askAuth(w)
52 return
53 }
54 http.Error(w, "geen leesrechten", http.StatusForbidden)
55 return
56 }
57 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
58 var before map[string]string
59 var extra []string
60 if write {
61 before, _ = gitrepo.Refs(r.Context(), s.Git, dir)
62 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
63 extra = gitrepo.PushEnv(role, patterns)
64 }
65 rest := strings.TrimPrefix(r.URL.Path, "/"+owner+"/"+repoSeg)
66 pathInfo := gitrepo.PathInfo(owner, repoSeg, rest)
67 if err := gitrepo.ServeSmartHTTP(w, r, s.Git, gitrepo.ProjectRoot(s.StoragePath()), pathInfo, extra); err != nil && s.Log != nil {
68 s.Log.Error("git http", "err", err, "path", r.URL.Path)
69 }
70 if write {
71 after, err := gitrepo.Refs(r.Context(), s.Git, dir)
72 if err == nil {
73 s.AfterPush(repo, user, before, after)
74 }
75 }
76}
77
78func (s *Server) gitUser(r *http.Request) (store.User, bool) {
79 _, pass, ok := r.BasicAuth()
80 if !ok {
81 h := r.Header.Get("Authorization")
82 if strings.HasPrefix(strings.ToLower(h), "bearer ") {
83 pass = strings.TrimSpace(h[7:])
84 ok = pass != ""
85 }
86 }
87 if !ok || !strings.HasPrefix(pass, "bg_") {
88 return store.User{}, false
89 }
90 u, err := s.Store.UserByToken(r.Context(), pass)
91 return u, err == nil
92}
93
94func (s *Server) askAuth(w http.ResponseWriter) {
95 w.Header().Set("WWW-Authenticate", `Basic realm="BlueGit"`)
96 http.Error(w, "aanmelden met een toegangstoken als wachtwoord", http.StatusUnauthorized)
97}
internal/server/repo_handlers.go added +459 −0
@@ -0,0 +1,459 @@
1 package server
2
3 import (
4 "net/http"
5 "strconv"
6 "strings"
7
8 "gitlab.com/Timfa/bluegit/internal/access"
9 "gitlab.com/Timfa/bluegit/internal/gitrepo"
10 "gitlab.com/Timfa/bluegit/internal/names"
11 "gitlab.com/Timfa/bluegit/internal/store"
12 )
13
14 func (s *Server) guard(w http.ResponseWriter, r *http.Request, min access.Role) (store.User, store.Repo, access.Role, bool) {
15 owner := r.PathValue("owner")
16 name := strings.TrimSuffix(r.PathValue("repo"), ".git")
17 repo, err := s.Store.RepoByPath(r.Context(), owner, name)
18 if err != nil {
19 http.NotFound(w, r)
20 return store.User{}, store.Repo{}, "", false
21 }
22 p := s.who(r)
23 var role access.Role
24 if p.OK {
25 role, err = s.Store.EffectiveRole(r.Context(), p.User.ID, repo.ID)
26 if err != nil {
27 http.Error(w, "rechten", http.StatusInternalServerError)
28 return store.User{}, store.Repo{}, "", false
29 }
30 }
31 readable := role.CanRead() || repo.Visibility == "public"
32 if !readable {
33 if p.OK {
34 http.Error(w, "geen toegang", http.StatusForbidden)
35 } else {
36 http.NotFound(w, r)
37 }
38 return store.User{}, store.Repo{}, "", false
39 }
40 if min != access.RoleReadonly && !role.AtLeast(min) {
41 http.Error(w, "geen toegang", http.StatusForbidden)
42 return store.User{}, store.Repo{}, "", false
43 }
44 return p.User, repo, role, true
45 }
46
47 func (s *Server) repoView(w http.ResponseWriter, r *http.Request, repo store.Repo, role access.Role, title string) View {
48 v := s.view(w, r, title)
49 v.Repo = &repo
50 v.Role = role
51 v.CanWrite = role.CanWriteCode()
52 v.CanAdmin = role.CanManageSettings()
53 v.Rev = safeRev(r.URL.Query().Get("rev"), repo.DefaultBranch)
54 v.CloneHTTP = strings.TrimRight(s.Cfg.BaseURL, "/") + "/" + repo.FullPath() + ".git"
55 v.CloneSSH = s.Cfg.CloneSSH(repo.FullPath())
56 return v
57 }
58
59 func (s *Server) repoHome(w http.ResponseWriter, r *http.Request) {
60 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
61 if !ok {
62 return
63 }
64 v := s.repoView(w, r, repo, role, repo.FullPath())
65 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
66 commits, _ := gitrepo.Log(r.Context(), s.Git, dir, v.Rev, 8)
67 v.Commits = toCommits(commits)
68 entries, err := gitrepo.Tree(r.Context(), s.Git, dir, v.Rev, "")
69 if err == nil {
70 v.Entries = toEntries("", entries)
71 }
72 s.render(w, "repo", v)
73 }
74
75 func (s *Server) tree(w http.ResponseWriter, r *http.Request) {
76 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
77 if !ok {
78 return
79 }
80 rel, err := cleanRel(r.PathValue("path"))
81 if err != nil {
82 http.NotFound(w, r)
83 return
84 }
85 v := s.repoView(w, r, repo, role, rel)
86 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
87 entries, err := gitrepo.Tree(r.Context(), s.Git, dir, v.Rev, rel)
88 if err != nil {
89 http.NotFound(w, r)
90 return
91 }
92 v.TreePath = rel
93 v.Entries = toEntries(rel, entries)
94 s.render(w, "tree", v)
95 }
96
97 func (s *Server) blob(w http.ResponseWriter, r *http.Request) {
98 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
99 if !ok {
100 return
101 }
102 rel, err := cleanRel(r.PathValue("path"))
103 if err != nil || rel == "" {
104 http.NotFound(w, r)
105 return
106 }
107 v := s.repoView(w, r, repo, role, rel)
108 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
109 text, binary, err := gitrepo.Blob(r.Context(), s.Git, dir, v.Rev, rel, 200_000)
110 if err != nil {
111 http.NotFound(w, r)
112 return
113 }
114 v.BlobPath = rel
115 v.Blob = text
116 v.Binary = binary
117 s.render(w, "blob", v)
118 }
119
120 func (s *Server) commits(w http.ResponseWriter, r *http.Request) {
121 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
122 if !ok {
123 return
124 }
125 v := s.repoView(w, r, repo, role, "Commits")
126 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
127 list, _ := gitrepo.Log(r.Context(), s.Git, dir, v.Rev, 50)
128 v.Commits = toCommits(list)
129 s.render(w, "commits", v)
130 }
131
132 func (s *Server) commit(w http.ResponseWriter, r *http.Request) {
133 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
134 if !ok {
135 return
136 }
137 sha := r.PathValue("sha")
138 if !safeSHA(sha) {
139 http.NotFound(w, r)
140 return
141 }
142 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
143 c, err := gitrepo.Show(r.Context(), s.Git, dir, sha)
144 if err != nil {
145 http.NotFound(w, r)
146 return
147 }
148 v := s.repoView(w, r, repo, role, c.Subject)
149 row := toCommits([]gitrepo.Commit{c})[0]
150 v.Commit = &row
151 s.render(w, "commit", v)
152 }
153
154 func (s *Server) branches(w http.ResponseWriter, r *http.Request) {
155 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
156 if !ok {
157 return
158 }
159 v := s.repoView(w, r, repo, role, "Branches")
160 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
161 names, _ := gitrepo.Branches(r.Context(), s.Git, dir)
162 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
163 for _, name := range names {
164 v.Branches = append(v.Branches, BranchRow{Name: name, Protected: access.BranchProtected(patterns, name)})
165 }
166 s.render(w, "branches", v)
167 }
168
169 func (s *Server) mergeRequests(w http.ResponseWriter, r *http.Request) {
170 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
171 if !ok {
172 return
173 }
174 v := s.repoView(w, r, repo, role, "Merge requests")
175 v.MRs, _ = s.Store.ListMergeRequests(r.Context(), repo.ID)
176 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
177 names, _ := gitrepo.Branches(r.Context(), s.Git, dir)
178 for _, name := range names {
179 v.Branches = append(v.Branches, BranchRow{Name: name})
180 }
181 s.render(w, "mrs", v)
182 }
183
184 func (s *Server) createMR(w http.ResponseWriter, r *http.Request) {
185 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
186 if !ok || !s.csrfOK(w, r) {
187 return
188 }
189 if !role.CanWriteCode() {
190 http.Error(w, "geen toegang", http.StatusForbidden)
191 return
192 }
193 source := safeRev(r.FormValue("source"), "")
194 target := safeRev(r.FormValue("target"), repo.DefaultBranch)
195 if source == "" || source == target {
196 s.redirect(w, r, repoURL(repo)+"/-/merge-requests", "", "kies twee verschillende branches")
197 return
198 }
199 mr, err := s.Store.CreateMergeRequest(r.Context(), repo.ID, u.ID, r.FormValue("title"), r.FormValue("description"), source, target)
200 if err != nil {
201 s.redirect(w, r, repoURL(repo)+"/-/merge-requests", "", err.Error())
202 return
203 }
204 s.Dispatch(repo.ID, pushEvent(repo, "merge_request", target, "", u.Username, "merge request !"+strconv.FormatInt(mr.Number, 10)+" geopend: "+mr.Title, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10)))
205 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Merge request geopend", "")
206 }
207
208 func (s *Server) showMR(w http.ResponseWriter, r *http.Request) {
209 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
210 if !ok {
211 return
212 }
213 n, err := strconv.ParseInt(r.PathValue("number"), 10, 64)
214 if err != nil {
215 http.NotFound(w, r)
216 return
217 }
218 mr, err := s.Store.MergeRequestByNumber(r.Context(), repo.ID, n)
219 if err != nil {
220 http.NotFound(w, r)
221 return
222 }
223 v := s.repoView(w, r, repo, role, mr.Title)
224 v.MR = &mr
225 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
226 v.CanMerge = mr.Status == "open" && role.CanMerge(access.BranchProtected(patterns, mr.TargetBranch))
227 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
228 diff, err := gitrepo.DiffStat(r.Context(), s.Git, dir, mr.TargetBranch, mr.SourceBranch)
229 if err == nil {
230 v.Diff = diff
231 }
232 s.render(w, "mr", v)
233 }
234
235 func (s *Server) mergeMR(w http.ResponseWriter, r *http.Request) {
236 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
237 if !ok || !s.csrfOK(w, r) {
238 return
239 }
240 mr, err := s.mrFromRequest(r, repo.ID)
241 if err != nil || mr.Status != "open" {
242 http.NotFound(w, r)
243 return
244 }
245 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
246 if !role.CanMerge(access.BranchProtected(patterns, mr.TargetBranch)) {
247 http.Error(w, "geen toegang tot de doelbranch", http.StatusForbidden)
248 return
249 }
250 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
251 before, _ := gitrepo.Refs(r.Context(), s.Git, dir)
252 work := s.StoragePath() + "/tmp/merge-" + strconv.FormatInt(mr.ID, 10)
253 email := u.Username + "@users.git.timfalken.com"
254 msg := "Merge branch '" + mr.SourceBranch + "' into '" + mr.TargetBranch + "'"
255 if err := gitrepo.Merge(r.Context(), s.Git, dir, work, mr.SourceBranch, mr.TargetBranch, u.Username, email, msg, role, patterns); err != nil {
256 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "", err.Error())
257 return
258 }
259 _ = s.Store.SetMergeRequestStatus(r.Context(), mr.ID, "merged")
260 after, _ := gitrepo.Refs(r.Context(), s.Git, dir)
261 s.AfterPush(repo, u, before, after)
262 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Samengevoegd", "")
263 }
264
265 func (s *Server) closeMR(w http.ResponseWriter, r *http.Request) {
266 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
267 if !ok || !s.csrfOK(w, r) {
268 return
269 }
270 mr, err := s.mrFromRequest(r, repo.ID)
271 if err != nil {
272 http.NotFound(w, r)
273 return
274 }
275 if mr.AuthorID != u.ID && !role.CanManageSettings() {
276 http.Error(w, "geen toegang", http.StatusForbidden)
277 return
278 }
279 _ = s.Store.SetMergeRequestStatus(r.Context(), mr.ID, "closed")
280 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Gesloten", "")
281 }
282
283 func (s *Server) mrFromRequest(r *http.Request, repoID int64) (store.MergeRequest, error) {
284 n, err := strconv.ParseInt(r.PathValue("number"), 10, 64)
285 if err != nil {
286 return store.MergeRequest{}, err
287 }
288 return s.Store.MergeRequestByNumber(r.Context(), repoID, n)
289 }
290
291 func (s *Server) pipelines(w http.ResponseWriter, r *http.Request) {
292 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
293 if !ok {
294 return
295 }
296 v := s.repoView(w, r, repo, role, "Pipelines")
297 v.Pipes, _ = s.Store.ListPipelines(r.Context(), repo.ID)
298 s.render(w, "pipelines", v)
299 }
300
301 func (s *Server) pipeline(w http.ResponseWriter, r *http.Request) {
302 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
303 if !ok {
304 return
305 }
306 id, err := strconv.ParseInt(r.PathValue("id"), 10, 64)
307 if err != nil {
308 http.NotFound(w, r)
309 return
310 }
311 p, err := s.Store.PipelineByID(r.Context(), repo.ID, id)
312 if err != nil {
313 http.NotFound(w, r)
314 return
315 }
316 v := s.repoView(w, r, repo, role, "Pipeline")
317 v.Pipe = &p
318 v.Jobs, _ = s.Store.JobsByPipeline(r.Context(), p.ID)
319 s.render(w, "pipeline", v)
320 }
321
322 func (s *Server) runPipeline(w http.ResponseWriter, r *http.Request) {
323 u, repo, _, ok := s.guard(w, r, access.RoleDeveloper)
324 if !ok || !s.csrfOK(w, r) {
325 return
326 }
327 ref := safeRev(r.FormValue("ref"), repo.DefaultBranch)
328 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
329 shaOut, err := gitSHA(r, s.Git, dir, ref)
330 if err != nil {
331 s.redirect(w, r, repoURL(repo)+"/-/pipelines", "", "branch niet gevonden")
332 return
333 }
334 s.startPipeline(r.Context(), repo, shaOut, "refs/heads/"+ref, u.Username)
335 s.redirect(w, r, repoURL(repo)+"/-/pipelines", "Pipeline gestart", "")
336 }
337
338 func (s *Server) releases(w http.ResponseWriter, r *http.Request) {
339 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
340 if !ok {
341 return
342 }
343 v := s.repoView(w, r, repo, role, "Releases")
344 v.Releases, _ = s.Store.ListReleases(r.Context(), repo.ID)
345 s.render(w, "releases", v)
346 }
347
348 func (s *Server) createRepo(w http.ResponseWriter, r *http.Request) {
349 u, ok := s.loginRequired(w, r)
350 if !ok || !s.csrfOK(w, r) {
351 return
352 }
353 if s.StoragePath() == "" {
354 s.redirect(w, r, "/", "", strings.TrimSpace(noStorageMsg))
355 return
356 }
357 name := strings.TrimSpace(r.FormValue("name"))
358 if err := names.ValidRepoName(name); err != nil {
359 s.redirect(w, r, "/new", "", err.Error())
360 return
361 }
362 ownerKind := "user"
363 ownerID := u.ID
364 if gpath := strings.TrimSpace(r.FormValue("group")); gpath != "" {
365 g, err := s.Store.GroupByPath(r.Context(), gpath)
366 if err != nil {
367 s.redirect(w, r, "/new", "", "groep niet gevonden")
368 return
369 }
370 role, err := s.Store.GroupRole(r.Context(), g.ID, u.ID)
371 if err != nil || !role.CanManageSettings() {
372 http.Error(w, "geen toegang", http.StatusForbidden)
373 return
374 }
375 ownerKind, ownerID = "group", g.ID
376 }
377 vis := r.FormValue("visibility")
378 if vis != "public" {
379 vis = "private"
380 }
381 repo, err := s.Store.CreateRepo(r.Context(), ownerKind, ownerID, name, r.FormValue("description"), s.Cfg.Git.DefaultBranch, vis)
382 if err != nil {
383 s.redirect(w, r, "/new", "", err.Error())
384 return
385 }
386 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
387 if err := gitrepo.Init(s.Git, dir, repo.DefaultBranch, s.HookBin); err != nil {
388 _ = s.Store.DeleteRepo(r.Context(), repo.ID)
389 s.redirect(w, r, "/new", "", "git init: "+err.Error())
390 return
391 }
392 s.redirect(w, r, repoURL(repo), "Repository aangemaakt", "")
393 }
394
395 func (s *Server) createGroup(w http.ResponseWriter, r *http.Request) {
396 u, ok := s.loginRequired(w, r)
397 if !ok || !s.csrfOK(w, r) {
398 return
399 }
400 g, err := s.Store.CreateGroup(r.Context(), u.ID, r.FormValue("name"), r.FormValue("path"), r.FormValue("description"))
401 if err != nil {
402 s.redirect(w, r, "/new", "", err.Error())
403 return
404 }
405 s.redirect(w, r, "/groups/"+g.Path, "Groep aangemaakt", "")
406 }
407
408 func toCommits(in []gitrepo.Commit) []CommitRow {
409 var out []CommitRow
410 for _, c := range in {
411 out = append(out, CommitRow{SHA: c.SHA, Short: c.Short, Author: c.Author, Date: c.Date, Subject: c.Subject, Body: c.Body})
412 }
413 return out
414 }
415
416 func toEntries(base string, in []gitrepo.Entry) []EntryRow {
417 var out []EntryRow
418 for _, e := range in {
419 p := e.Name
420 if base != "" {
421 p = base + "/" + e.Name
422 }
423 out = append(out, EntryRow{Name: e.Name, Type: e.Type, Path: p})
424 }
425 return out
426 }
427
428 func cleanRel(p string) (string, error) {
429 p = strings.TrimPrefix(p, "/")
430 if p == "" || p == "." {
431 return "", nil
432 }
433 if strings.HasPrefix(p, "/") || strings.Contains(p, "\\") || strings.Contains(p, "..") {
434 return "", errBadID
435 }
436 return p, nil
437 }
438
439 func safeRev(s, fallback string) string {
440 if s == "" {
441 return fallback
442 }
443 if strings.HasPrefix(s, "-") || strings.Contains(s, "..") || strings.ContainsAny(s, " \t\n~^:?*[\\") {
444 return fallback
445 }
446 return s
447 }
448
449 func safeSHA(s string) bool {
450 if len(s) < 7 || len(s) > 64 {
451 return false
452 }
453 for _, c := range s {
454 if (c < '0' || c > '9') && (c < 'a' || c > 'f') && (c < 'A' || c > 'F') {
455 return false
456 }
457 }
458 return true
459 }
@@ -0,0 +1,459 @@
1package server
2
3import (
4 "net/http"
5 "strconv"
6 "strings"
7
8 "gitlab.com/Timfa/bluegit/internal/access"
9 "gitlab.com/Timfa/bluegit/internal/gitrepo"
10 "gitlab.com/Timfa/bluegit/internal/names"
11 "gitlab.com/Timfa/bluegit/internal/store"
12)
13
14func (s *Server) guard(w http.ResponseWriter, r *http.Request, min access.Role) (store.User, store.Repo, access.Role, bool) {
15 owner := r.PathValue("owner")
16 name := strings.TrimSuffix(r.PathValue("repo"), ".git")
17 repo, err := s.Store.RepoByPath(r.Context(), owner, name)
18 if err != nil {
19 http.NotFound(w, r)
20 return store.User{}, store.Repo{}, "", false
21 }
22 p := s.who(r)
23 var role access.Role
24 if p.OK {
25 role, err = s.Store.EffectiveRole(r.Context(), p.User.ID, repo.ID)
26 if err != nil {
27 http.Error(w, "rechten", http.StatusInternalServerError)
28 return store.User{}, store.Repo{}, "", false
29 }
30 }
31 readable := role.CanRead() || repo.Visibility == "public"
32 if !readable {
33 if p.OK {
34 http.Error(w, "geen toegang", http.StatusForbidden)
35 } else {
36 http.NotFound(w, r)
37 }
38 return store.User{}, store.Repo{}, "", false
39 }
40 if min != access.RoleReadonly && !role.AtLeast(min) {
41 http.Error(w, "geen toegang", http.StatusForbidden)
42 return store.User{}, store.Repo{}, "", false
43 }
44 return p.User, repo, role, true
45}
46
47func (s *Server) repoView(w http.ResponseWriter, r *http.Request, repo store.Repo, role access.Role, title string) View {
48 v := s.view(w, r, title)
49 v.Repo = &repo
50 v.Role = role
51 v.CanWrite = role.CanWriteCode()
52 v.CanAdmin = role.CanManageSettings()
53 v.Rev = safeRev(r.URL.Query().Get("rev"), repo.DefaultBranch)
54 v.CloneHTTP = strings.TrimRight(s.Cfg.BaseURL, "/") + "/" + repo.FullPath() + ".git"
55 v.CloneSSH = s.Cfg.CloneSSH(repo.FullPath())
56 return v
57}
58
59func (s *Server) repoHome(w http.ResponseWriter, r *http.Request) {
60 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
61 if !ok {
62 return
63 }
64 v := s.repoView(w, r, repo, role, repo.FullPath())
65 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
66 commits, _ := gitrepo.Log(r.Context(), s.Git, dir, v.Rev, 8)
67 v.Commits = toCommits(commits)
68 entries, err := gitrepo.Tree(r.Context(), s.Git, dir, v.Rev, "")
69 if err == nil {
70 v.Entries = toEntries("", entries)
71 }
72 s.render(w, "repo", v)
73}
74
75func (s *Server) tree(w http.ResponseWriter, r *http.Request) {
76 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
77 if !ok {
78 return
79 }
80 rel, err := cleanRel(r.PathValue("path"))
81 if err != nil {
82 http.NotFound(w, r)
83 return
84 }
85 v := s.repoView(w, r, repo, role, rel)
86 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
87 entries, err := gitrepo.Tree(r.Context(), s.Git, dir, v.Rev, rel)
88 if err != nil {
89 http.NotFound(w, r)
90 return
91 }
92 v.TreePath = rel
93 v.Entries = toEntries(rel, entries)
94 s.render(w, "tree", v)
95}
96
97func (s *Server) blob(w http.ResponseWriter, r *http.Request) {
98 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
99 if !ok {
100 return
101 }
102 rel, err := cleanRel(r.PathValue("path"))
103 if err != nil || rel == "" {
104 http.NotFound(w, r)
105 return
106 }
107 v := s.repoView(w, r, repo, role, rel)
108 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
109 text, binary, err := gitrepo.Blob(r.Context(), s.Git, dir, v.Rev, rel, 200_000)
110 if err != nil {
111 http.NotFound(w, r)
112 return
113 }
114 v.BlobPath = rel
115 v.Blob = text
116 v.Binary = binary
117 s.render(w, "blob", v)
118}
119
120func (s *Server) commits(w http.ResponseWriter, r *http.Request) {
121 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
122 if !ok {
123 return
124 }
125 v := s.repoView(w, r, repo, role, "Commits")
126 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
127 list, _ := gitrepo.Log(r.Context(), s.Git, dir, v.Rev, 50)
128 v.Commits = toCommits(list)
129 s.render(w, "commits", v)
130}
131
132func (s *Server) commit(w http.ResponseWriter, r *http.Request) {
133 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
134 if !ok {
135 return
136 }
137 sha := r.PathValue("sha")
138 if !safeSHA(sha) {
139 http.NotFound(w, r)
140 return
141 }
142 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
143 c, err := gitrepo.Show(r.Context(), s.Git, dir, sha)
144 if err != nil {
145 http.NotFound(w, r)
146 return
147 }
148 v := s.repoView(w, r, repo, role, c.Subject)
149 row := toCommits([]gitrepo.Commit{c})[0]
150 v.Commit = &row
151 s.render(w, "commit", v)
152}
153
154func (s *Server) branches(w http.ResponseWriter, r *http.Request) {
155 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
156 if !ok {
157 return
158 }
159 v := s.repoView(w, r, repo, role, "Branches")
160 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
161 names, _ := gitrepo.Branches(r.Context(), s.Git, dir)
162 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
163 for _, name := range names {
164 v.Branches = append(v.Branches, BranchRow{Name: name, Protected: access.BranchProtected(patterns, name)})
165 }
166 s.render(w, "branches", v)
167}
168
169func (s *Server) mergeRequests(w http.ResponseWriter, r *http.Request) {
170 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
171 if !ok {
172 return
173 }
174 v := s.repoView(w, r, repo, role, "Merge requests")
175 v.MRs, _ = s.Store.ListMergeRequests(r.Context(), repo.ID)
176 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
177 names, _ := gitrepo.Branches(r.Context(), s.Git, dir)
178 for _, name := range names {
179 v.Branches = append(v.Branches, BranchRow{Name: name})
180 }
181 s.render(w, "mrs", v)
182}
183
184func (s *Server) createMR(w http.ResponseWriter, r *http.Request) {
185 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
186 if !ok || !s.csrfOK(w, r) {
187 return
188 }
189 if !role.CanWriteCode() {
190 http.Error(w, "geen toegang", http.StatusForbidden)
191 return
192 }
193 source := safeRev(r.FormValue("source"), "")
194 target := safeRev(r.FormValue("target"), repo.DefaultBranch)
195 if source == "" || source == target {
196 s.redirect(w, r, repoURL(repo)+"/-/merge-requests", "", "kies twee verschillende branches")
197 return
198 }
199 mr, err := s.Store.CreateMergeRequest(r.Context(), repo.ID, u.ID, r.FormValue("title"), r.FormValue("description"), source, target)
200 if err != nil {
201 s.redirect(w, r, repoURL(repo)+"/-/merge-requests", "", err.Error())
202 return
203 }
204 s.Dispatch(repo.ID, pushEvent(repo, "merge_request", target, "", u.Username, "merge request !"+strconv.FormatInt(mr.Number, 10)+" geopend: "+mr.Title, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10)))
205 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Merge request geopend", "")
206}
207
208func (s *Server) showMR(w http.ResponseWriter, r *http.Request) {
209 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
210 if !ok {
211 return
212 }
213 n, err := strconv.ParseInt(r.PathValue("number"), 10, 64)
214 if err != nil {
215 http.NotFound(w, r)
216 return
217 }
218 mr, err := s.Store.MergeRequestByNumber(r.Context(), repo.ID, n)
219 if err != nil {
220 http.NotFound(w, r)
221 return
222 }
223 v := s.repoView(w, r, repo, role, mr.Title)
224 v.MR = &mr
225 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
226 v.CanMerge = mr.Status == "open" && role.CanMerge(access.BranchProtected(patterns, mr.TargetBranch))
227 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
228 diff, err := gitrepo.DiffStat(r.Context(), s.Git, dir, mr.TargetBranch, mr.SourceBranch)
229 if err == nil {
230 v.Diff = diff
231 }
232 s.render(w, "mr", v)
233}
234
235func (s *Server) mergeMR(w http.ResponseWriter, r *http.Request) {
236 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
237 if !ok || !s.csrfOK(w, r) {
238 return
239 }
240 mr, err := s.mrFromRequest(r, repo.ID)
241 if err != nil || mr.Status != "open" {
242 http.NotFound(w, r)
243 return
244 }
245 patterns, _ := s.Store.ProtectedPatterns(r.Context(), repo.ID)
246 if !role.CanMerge(access.BranchProtected(patterns, mr.TargetBranch)) {
247 http.Error(w, "geen toegang tot de doelbranch", http.StatusForbidden)
248 return
249 }
250 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
251 before, _ := gitrepo.Refs(r.Context(), s.Git, dir)
252 work := s.StoragePath() + "/tmp/merge-" + strconv.FormatInt(mr.ID, 10)
253 email := u.Username + "@users.git.timfalken.com"
254 msg := "Merge branch '" + mr.SourceBranch + "' into '" + mr.TargetBranch + "'"
255 if err := gitrepo.Merge(r.Context(), s.Git, dir, work, mr.SourceBranch, mr.TargetBranch, u.Username, email, msg, role, patterns); err != nil {
256 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "", err.Error())
257 return
258 }
259 _ = s.Store.SetMergeRequestStatus(r.Context(), mr.ID, "merged")
260 after, _ := gitrepo.Refs(r.Context(), s.Git, dir)
261 s.AfterPush(repo, u, before, after)
262 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Samengevoegd", "")
263}
264
265func (s *Server) closeMR(w http.ResponseWriter, r *http.Request) {
266 u, repo, role, ok := s.guard(w, r, access.RoleDeveloper)
267 if !ok || !s.csrfOK(w, r) {
268 return
269 }
270 mr, err := s.mrFromRequest(r, repo.ID)
271 if err != nil {
272 http.NotFound(w, r)
273 return
274 }
275 if mr.AuthorID != u.ID && !role.CanManageSettings() {
276 http.Error(w, "geen toegang", http.StatusForbidden)
277 return
278 }
279 _ = s.Store.SetMergeRequestStatus(r.Context(), mr.ID, "closed")
280 s.redirect(w, r, repoURL(repo)+"/-/merge-requests/"+strconv.FormatInt(mr.Number, 10), "Gesloten", "")
281}
282
283func (s *Server) mrFromRequest(r *http.Request, repoID int64) (store.MergeRequest, error) {
284 n, err := strconv.ParseInt(r.PathValue("number"), 10, 64)
285 if err != nil {
286 return store.MergeRequest{}, err
287 }
288 return s.Store.MergeRequestByNumber(r.Context(), repoID, n)
289}
290
291func (s *Server) pipelines(w http.ResponseWriter, r *http.Request) {
292 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
293 if !ok {
294 return
295 }
296 v := s.repoView(w, r, repo, role, "Pipelines")
297 v.Pipes, _ = s.Store.ListPipelines(r.Context(), repo.ID)
298 s.render(w, "pipelines", v)
299}
300
301func (s *Server) pipeline(w http.ResponseWriter, r *http.Request) {
302 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
303 if !ok {
304 return
305 }
306 id, err := strconv.ParseInt(r.PathValue("id"), 10, 64)
307 if err != nil {
308 http.NotFound(w, r)
309 return
310 }
311 p, err := s.Store.PipelineByID(r.Context(), repo.ID, id)
312 if err != nil {
313 http.NotFound(w, r)
314 return
315 }
316 v := s.repoView(w, r, repo, role, "Pipeline")
317 v.Pipe = &p
318 v.Jobs, _ = s.Store.JobsByPipeline(r.Context(), p.ID)
319 s.render(w, "pipeline", v)
320}
321
322func (s *Server) runPipeline(w http.ResponseWriter, r *http.Request) {
323 u, repo, _, ok := s.guard(w, r, access.RoleDeveloper)
324 if !ok || !s.csrfOK(w, r) {
325 return
326 }
327 ref := safeRev(r.FormValue("ref"), repo.DefaultBranch)
328 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
329 shaOut, err := gitSHA(r, s.Git, dir, ref)
330 if err != nil {
331 s.redirect(w, r, repoURL(repo)+"/-/pipelines", "", "branch niet gevonden")
332 return
333 }
334 s.startPipeline(r.Context(), repo, shaOut, "refs/heads/"+ref, u.Username)
335 s.redirect(w, r, repoURL(repo)+"/-/pipelines", "Pipeline gestart", "")
336}
337
338func (s *Server) releases(w http.ResponseWriter, r *http.Request) {
339 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
340 if !ok {
341 return
342 }
343 v := s.repoView(w, r, repo, role, "Releases")
344 v.Releases, _ = s.Store.ListReleases(r.Context(), repo.ID)
345 s.render(w, "releases", v)
346}
347
348func (s *Server) createRepo(w http.ResponseWriter, r *http.Request) {
349 u, ok := s.loginRequired(w, r)
350 if !ok || !s.csrfOK(w, r) {
351 return
352 }
353 if s.StoragePath() == "" {
354 s.redirect(w, r, "/", "", strings.TrimSpace(noStorageMsg))
355 return
356 }
357 name := strings.TrimSpace(r.FormValue("name"))
358 if err := names.ValidRepoName(name); err != nil {
359 s.redirect(w, r, "/new", "", err.Error())
360 return
361 }
362 ownerKind := "user"
363 ownerID := u.ID
364 if gpath := strings.TrimSpace(r.FormValue("group")); gpath != "" {
365 g, err := s.Store.GroupByPath(r.Context(), gpath)
366 if err != nil {
367 s.redirect(w, r, "/new", "", "groep niet gevonden")
368 return
369 }
370 role, err := s.Store.GroupRole(r.Context(), g.ID, u.ID)
371 if err != nil || !role.CanManageSettings() {
372 http.Error(w, "geen toegang", http.StatusForbidden)
373 return
374 }
375 ownerKind, ownerID = "group", g.ID
376 }
377 vis := r.FormValue("visibility")
378 if vis != "public" {
379 vis = "private"
380 }
381 repo, err := s.Store.CreateRepo(r.Context(), ownerKind, ownerID, name, r.FormValue("description"), s.Cfg.Git.DefaultBranch, vis)
382 if err != nil {
383 s.redirect(w, r, "/new", "", err.Error())
384 return
385 }
386 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
387 if err := gitrepo.Init(s.Git, dir, repo.DefaultBranch, s.HookBin); err != nil {
388 _ = s.Store.DeleteRepo(r.Context(), repo.ID)
389 s.redirect(w, r, "/new", "", "git init: "+err.Error())
390 return
391 }
392 s.redirect(w, r, repoURL(repo), "Repository aangemaakt", "")
393}
394
395func (s *Server) createGroup(w http.ResponseWriter, r *http.Request) {
396 u, ok := s.loginRequired(w, r)
397 if !ok || !s.csrfOK(w, r) {
398 return
399 }
400 g, err := s.Store.CreateGroup(r.Context(), u.ID, r.FormValue("name"), r.FormValue("path"), r.FormValue("description"))
401 if err != nil {
402 s.redirect(w, r, "/new", "", err.Error())
403 return
404 }
405 s.redirect(w, r, "/groups/"+g.Path, "Groep aangemaakt", "")
406}
407
408func toCommits(in []gitrepo.Commit) []CommitRow {
409 var out []CommitRow
410 for _, c := range in {
411 out = append(out, CommitRow{SHA: c.SHA, Short: c.Short, Author: c.Author, Date: c.Date, Subject: c.Subject, Body: c.Body})
412 }
413 return out
414}
415
416func toEntries(base string, in []gitrepo.Entry) []EntryRow {
417 var out []EntryRow
418 for _, e := range in {
419 p := e.Name
420 if base != "" {
421 p = base + "/" + e.Name
422 }
423 out = append(out, EntryRow{Name: e.Name, Type: e.Type, Path: p})
424 }
425 return out
426}
427
428func cleanRel(p string) (string, error) {
429 p = strings.TrimPrefix(p, "/")
430 if p == "" || p == "." {
431 return "", nil
432 }
433 if strings.HasPrefix(p, "/") || strings.Contains(p, "\\") || strings.Contains(p, "..") {
434 return "", errBadID
435 }
436 return p, nil
437}
438
439func safeRev(s, fallback string) string {
440 if s == "" {
441 return fallback
442 }
443 if strings.HasPrefix(s, "-") || strings.Contains(s, "..") || strings.ContainsAny(s, " \t\n~^:?*[\\") {
444 return fallback
445 }
446 return s
447}
448
449func safeSHA(s string) bool {
450 if len(s) < 7 || len(s) > 64 {
451 return false
452 }
453 for _, c := range s {
454 if (c < '0' || c > '9') && (c < 'a' || c > 'f') && (c < 'A' || c > 'F') {
455 return false
456 }
457 }
458 return true
459}
internal/server/server.go added +373 −0
@@ -0,0 +1,373 @@
1 // Package server is de webinterface, de git-HTTP-server en de API.
2 package server
3
4 import (
5 "context"
6 "crypto/rand"
7 "embed"
8 "encoding/hex"
9 "html/template"
10 "io/fs"
11 "log/slog"
12 "net/http"
13 "strings"
14 "sync"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/auth"
19 "gitlab.com/Timfa/bluegit/internal/config"
20 "gitlab.com/Timfa/bluegit/internal/realip"
21 "gitlab.com/Timfa/bluegit/internal/runner"
22 "gitlab.com/Timfa/bluegit/internal/store"
23 )
24
25 //go:embed templates/*.html static/*
26 var webFS embed.FS
27
28 // Server bedient BlueGit.
29 type Server struct {
30 Cfg config.Config
31 Store *store.Store
32 Auth auth.Provider
33 Dev bool
34 Git string
35 HookBin string
36 Runner *runner.Runner
37 Log *slog.Logger
38 // StateDir is de map met database en het bestand storage_path.
39 StateDir string
40 // AfterStorage krijgt het nieuwe datadisk-pad, voor runner en SSH.
41 AfterStorage func(path string)
42 tmpl *template.Template
43
44 storageMu sync.RWMutex
45 storage string
46 storageSet bool
47 }
48
49 type principal struct {
50 User store.User
51 Session store.Session
52 OK bool
53 }
54
55 type ctxKey struct{}
56
57 // Handler is de HTTP-handler met sessies en koppen.
58 func (s *Server) Handler() http.Handler {
59 s.mustTemplates()
60 mux := http.NewServeMux()
61 mux.HandleFunc("GET /assets/{file}", s.asset)
62 mux.HandleFunc("GET /healthz", func(w http.ResponseWriter, r *http.Request) {
63 w.WriteHeader(http.StatusOK)
64 _, _ = w.Write([]byte("ok\n"))
65 })
66 mux.HandleFunc("GET /login", s.login)
67 mux.HandleFunc("GET /auth/callback", s.callback)
68 mux.HandleFunc("POST /logout", s.logout)
69 mux.HandleFunc("GET /{$}", s.home)
70 mux.HandleFunc("GET /new", s.newPage)
71 mux.HandleFunc("POST /new/repo", s.createRepo)
72 mux.HandleFunc("POST /new/group", s.createGroup)
73 mux.HandleFunc("GET /setup", s.setupPage)
74 mux.HandleFunc("POST /setup", s.setupSave)
75 mux.HandleFunc("GET /settings", s.account)
76 mux.HandleFunc("POST /settings/tokens", s.createToken)
77 mux.HandleFunc("POST /settings/tokens/delete", s.deleteToken)
78 mux.HandleFunc("POST /settings/ssh", s.addSSH)
79 mux.HandleFunc("POST /settings/ssh/delete", s.deleteSSH)
80 mux.HandleFunc("GET /settings/export", s.export)
81 mux.HandleFunc("GET /groups/{path}", s.groupPage)
82 mux.HandleFunc("POST /groups/{path}/members", s.groupMember)
83 mux.HandleFunc("POST /groups/{path}/members/remove", s.groupMemberRemove)
84 mux.HandleFunc("POST /groups/{path}/secrets", s.groupSecret)
85 mux.HandleFunc("POST /groups/{path}/secrets/delete", s.groupSecretDelete)
86 mux.HandleFunc("POST /groups/{path}/webhooks", s.groupWebhook)
87 mux.HandleFunc("POST /groups/{path}/webhooks/delete", s.groupWebhookDelete)
88
89 mux.HandleFunc("GET /{owner}/{repo}/info/refs", s.gitHTTP)
90 mux.HandleFunc("POST /{owner}/{repo}/git-upload-pack", s.gitHTTP)
91 mux.HandleFunc("POST /{owner}/{repo}/git-receive-pack", s.gitHTTP)
92 mux.HandleFunc("POST /api/v1/repos/{owner}/{repo}/releases", s.createRelease)
93
94 mux.HandleFunc("GET /{owner}/{repo}", s.repoHome)
95 mux.HandleFunc("GET /{owner}/{repo}/-/tree/{path...}", s.tree)
96 mux.HandleFunc("GET /{owner}/{repo}/-/blob/{path...}", s.blob)
97 mux.HandleFunc("GET /{owner}/{repo}/-/commits", s.commits)
98 mux.HandleFunc("GET /{owner}/{repo}/-/commit/{sha}", s.commit)
99 mux.HandleFunc("GET /{owner}/{repo}/-/branches", s.branches)
100 mux.HandleFunc("GET /{owner}/{repo}/-/merge-requests", s.mergeRequests)
101 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests", s.createMR)
102 mux.HandleFunc("GET /{owner}/{repo}/-/merge-requests/{number}", s.showMR)
103 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests/{number}/merge", s.mergeMR)
104 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests/{number}/close", s.closeMR)
105 mux.HandleFunc("GET /{owner}/{repo}/-/pipelines", s.pipelines)
106 mux.HandleFunc("POST /{owner}/{repo}/-/pipelines", s.runPipeline)
107 mux.HandleFunc("GET /{owner}/{repo}/-/pipelines/{id}", s.pipeline)
108 mux.HandleFunc("GET /{owner}/{repo}/-/releases", s.releases)
109 mux.HandleFunc("GET /{owner}/{repo}/-/releases/{tag}/assets/{name}", s.releaseAsset)
110 mux.HandleFunc("GET /{owner}/{repo}/-/settings", s.settings)
111 mux.HandleFunc("POST /{owner}/{repo}/-/settings", s.updateRepo)
112 mux.HandleFunc("POST /{owner}/{repo}/-/members", s.repoMember)
113 mux.HandleFunc("POST /{owner}/{repo}/-/members/remove", s.repoMemberRemove)
114 mux.HandleFunc("POST /{owner}/{repo}/-/protected", s.addProtected)
115 mux.HandleFunc("POST /{owner}/{repo}/-/protected/remove", s.removeProtected)
116 mux.HandleFunc("POST /{owner}/{repo}/-/secrets", s.repoSecret)
117 mux.HandleFunc("POST /{owner}/{repo}/-/secrets/delete", s.repoSecretDelete)
118 mux.HandleFunc("POST /{owner}/{repo}/-/webhooks", s.repoWebhook)
119 mux.HandleFunc("POST /{owner}/{repo}/-/webhooks/delete", s.repoWebhookDelete)
120 mux.HandleFunc("POST /{owner}/{repo}/-/delete", s.deleteRepo)
121
122 return s.realIP(s.withSession(s.secure(s.gate(mux))))
123 }
124
125 func (s *Server) realIP(next http.Handler) http.Handler {
126 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
127 realip.Apply(r, s.Cfg.ProxySet())
128 next.ServeHTTP(w, r)
129 })
130 }
131
132 func (s *Server) mustTemplates() {
133 if s.tmpl != nil {
134 return
135 }
136 s.tmpl = template.Must(template.New("web").Funcs(template.FuncMap{
137 "short": func(v string) string {
138 if len(v) > 10 {
139 return v[:10]
140 }
141 return v
142 },
143 "join": strings.Join,
144 }).ParseFS(webFS, "templates/*.html"))
145 }
146
147 func (s *Server) asset(w http.ResponseWriter, r *http.Request) {
148 name := r.PathValue("file")
149 if name == "" || strings.Contains(name, "/") || strings.Contains(name, "..") {
150 http.NotFound(w, r)
151 return
152 }
153 sub, err := fs.Sub(webFS, "static")
154 if err != nil {
155 http.Error(w, "assets", http.StatusInternalServerError)
156 return
157 }
158 http.ServeFileFS(w, r, sub, name)
159 }
160
161 func (s *Server) secure(next http.Handler) http.Handler {
162 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
163 w.Header().Set("X-Content-Type-Options", "nosniff")
164 w.Header().Set("X-Frame-Options", "DENY")
165 w.Header().Set("Referrer-Policy", "strict-origin-when-cross-origin")
166 w.Header().Set("Content-Security-Policy", "default-src 'self'; img-src 'self' https://auth.timfalken.com data:; style-src 'self'; form-action 'self'; base-uri 'self'; frame-ancestors 'none'")
167 next.ServeHTTP(w, r)
168 })
169 }
170
171 func (s *Server) withSession(next http.Handler) http.Handler {
172 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
173 p := principal{}
174 if c, err := r.Cookie("bluegit_session"); err == nil && c.Value != "" {
175 sess, err := s.Store.Session(r.Context(), c.Value)
176 if err == nil && sess.ExpiresAt.After(time.Now()) {
177 p.Session = sess
178 p.User = sess.User
179 p.OK = true
180 s.maybeExtend(r.Context(), sess)
181 }
182 }
183 next.ServeHTTP(w, r.WithContext(context.WithValue(r.Context(), ctxKey{}, p)))
184 })
185 }
186
187 func (s *Server) maybeExtend(ctx context.Context, sess store.Session) {
188 if time.Until(sess.ExpiresAt) > 6*time.Hour {
189 return
190 }
191 sec, err := s.Auth.Extend(ctx, sess.AccessToken)
192 if err != nil || sec <= 0 {
193 return
194 }
195 _ = s.Store.UpdateSessionExpiry(ctx, sess.ID, time.Now().Add(time.Duration(sec)*time.Second))
196 }
197
198 func (s *Server) who(r *http.Request) principal {
199 p, _ := r.Context().Value(ctxKey{}).(principal)
200 return p
201 }
202
203 func (s *Server) csrfOK(w http.ResponseWriter, r *http.Request) bool {
204 if err := r.ParseForm(); err != nil {
205 http.Error(w, "ongeldig formulier", http.StatusBadRequest)
206 return false
207 }
208 p := s.who(r)
209 if !p.OK || r.FormValue("csrf") == "" || r.FormValue("csrf") != p.Session.CSRF {
210 http.Error(w, "ongeldig formulier, vernieuw de pagina", http.StatusBadRequest)
211 return false
212 }
213 return true
214 }
215
216 func (s *Server) loginRequired(w http.ResponseWriter, r *http.Request) (store.User, bool) {
217 p := s.who(r)
218 if !p.OK {
219 http.Redirect(w, r, "/login", http.StatusFound)
220 return store.User{}, false
221 }
222 return p.User, true
223 }
224
225 func (s *Server) setSessionCookie(w http.ResponseWriter, id string, exp time.Time) {
226 http.SetCookie(w, &http.Cookie{
227 Name: "bluegit_session",
228 Value: id,
229 Path: "/",
230 HttpOnly: true,
231 SameSite: http.SameSiteLaxMode,
232 Secure: strings.HasPrefix(s.Cfg.BaseURL, "https://"),
233 Expires: exp,
234 })
235 }
236
237 func (s *Server) flash(w http.ResponseWriter, notice, problem string) {
238 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
239 if notice != "" {
240 http.SetCookie(w, &http.Cookie{Name: "bluegit_notice", Value: notice, Path: "/", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
241 }
242 if problem != "" {
243 http.SetCookie(w, &http.Cookie{Name: "bluegit_error", Value: problem, Path: "/", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
244 }
245 }
246
247 func (s *Server) takeFlash(w http.ResponseWriter, r *http.Request) (string, string) {
248 notice, problem := cookieVal(r, "bluegit_notice"), cookieVal(r, "bluegit_error")
249 if notice != "" {
250 http.SetCookie(w, &http.Cookie{Name: "bluegit_notice", Value: "", Path: "/", MaxAge: -1})
251 }
252 if problem != "" {
253 http.SetCookie(w, &http.Cookie{Name: "bluegit_error", Value: "", Path: "/", MaxAge: -1})
254 }
255 return notice, problem
256 }
257
258 func cookieVal(r *http.Request, name string) string {
259 c, err := r.Cookie(name)
260 if err != nil {
261 return ""
262 }
263 return c.Value
264 }
265
266 func (s *Server) redirect(w http.ResponseWriter, r *http.Request, path, notice, problem string) {
267 s.flash(w, notice, problem)
268 http.Redirect(w, r, path, http.StatusSeeOther)
269 }
270
271 func (s *Server) view(w http.ResponseWriter, r *http.Request, title string) View {
272 notice, problem := s.takeFlash(w, r)
273 v := View{Title: title, BaseURL: s.Cfg.BaseURL, Notice: notice, Err: problem, StorageUnset: s.StoragePath() == ""}
274 if p := s.who(r); p.OK {
275 u := p.User
276 v.User = &u
277 v.CSRF = p.Session.CSRF
278 }
279 return v
280 }
281
282 func (s *Server) render(w http.ResponseWriter, name string, v View) {
283 w.Header().Set("Content-Type", "text/html; charset=utf-8")
284 if err := s.tmpl.ExecuteTemplate(w, name, v); err != nil && s.Log != nil {
285 s.Log.Error("sjabloon", "name", name, "err", err)
286 }
287 }
288
289 func randomState() (string, error) {
290 b := make([]byte, 32)
291 if _, err := rand.Read(b); err != nil {
292 return "", err
293 }
294 return hex.EncodeToString(b), nil
295 }
296
297 // View is de gegevensset voor elk scherm.
298 type View struct {
299 Title string
300 BaseURL string
301 User *store.User
302 CSRF string
303 Notice string
304 Err string
305 Repos []store.Repo
306 Groups []store.Group
307 Repo *store.Repo
308 Role access.Role
309 CanWrite bool
310 CanAdmin bool
311 CanMerge bool
312 Commits []CommitRow
313 Commit *CommitRow
314 Entries []EntryRow
315 TreePath string
316 Blob string
317 BlobPath string
318 Binary bool
319 Branches []BranchRow
320 MRs []store.MergeRequest
321 MR *store.MergeRequest
322 Diff string
323 Pipes []store.Pipeline
324 Pipe *store.Pipeline
325 Jobs []store.Job
326 Releases []store.Release
327 Members []store.Member
328 Secrets []store.SecretMeta
329 Hooks []HookView
330 Patterns []string
331 Tokens []store.TokenInfo
332 Keys []store.SSHKey
333 CloneHTTP string
334 CloneSSH string
335 Group *store.Group
336 Tab string
337 Rev string
338 NewToken string
339 StorageUnset bool
340 StoragePath string
341 StorageFree string
342 StorageTotal string
343 MinFree string
344 }
345
346 // CommitRow is een commit in de interface.
347 type CommitRow struct {
348 SHA, Short, Author, Date, Subject, Body string
349 }
350
351 // EntryRow is een bestand of map.
352 type EntryRow struct {
353 Name, Type, Path string
354 }
355
356 // BranchRow is een branch, met of zonder bescherming.
357 type BranchRow struct {
358 Name string
359 Protected bool
360 }
361
362 // HookView is een webhook plus de laatste pogingen.
363 type HookView struct {
364 ID int64
365 Name string
366 Preset string
367 URL string
368 Filter string
369 Events string
370 Deliveries []store.Delivery
371 }
372
373 func repoURL(repo store.Repo) string { return "/" + repo.FullPath() }
@@ -0,0 +1,373 @@
1// Package server is de webinterface, de git-HTTP-server en de API.
2package server
3
4import (
5 "context"
6 "crypto/rand"
7 "embed"
8 "encoding/hex"
9 "html/template"
10 "io/fs"
11 "log/slog"
12 "net/http"
13 "strings"
14 "sync"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/access"
18 "gitlab.com/Timfa/bluegit/internal/auth"
19 "gitlab.com/Timfa/bluegit/internal/config"
20 "gitlab.com/Timfa/bluegit/internal/realip"
21 "gitlab.com/Timfa/bluegit/internal/runner"
22 "gitlab.com/Timfa/bluegit/internal/store"
23)
24
25//go:embed templates/*.html static/*
26var webFS embed.FS
27
28// Server bedient BlueGit.
29type Server struct {
30 Cfg config.Config
31 Store *store.Store
32 Auth auth.Provider
33 Dev bool
34 Git string
35 HookBin string
36 Runner *runner.Runner
37 Log *slog.Logger
38 // StateDir is de map met database en het bestand storage_path.
39 StateDir string
40 // AfterStorage krijgt het nieuwe datadisk-pad, voor runner en SSH.
41 AfterStorage func(path string)
42 tmpl *template.Template
43
44 storageMu sync.RWMutex
45 storage string
46 storageSet bool
47}
48
49type principal struct {
50 User store.User
51 Session store.Session
52 OK bool
53}
54
55type ctxKey struct{}
56
57// Handler is de HTTP-handler met sessies en koppen.
58func (s *Server) Handler() http.Handler {
59 s.mustTemplates()
60 mux := http.NewServeMux()
61 mux.HandleFunc("GET /assets/{file}", s.asset)
62 mux.HandleFunc("GET /healthz", func(w http.ResponseWriter, r *http.Request) {
63 w.WriteHeader(http.StatusOK)
64 _, _ = w.Write([]byte("ok\n"))
65 })
66 mux.HandleFunc("GET /login", s.login)
67 mux.HandleFunc("GET /auth/callback", s.callback)
68 mux.HandleFunc("POST /logout", s.logout)
69 mux.HandleFunc("GET /{$}", s.home)
70 mux.HandleFunc("GET /new", s.newPage)
71 mux.HandleFunc("POST /new/repo", s.createRepo)
72 mux.HandleFunc("POST /new/group", s.createGroup)
73 mux.HandleFunc("GET /setup", s.setupPage)
74 mux.HandleFunc("POST /setup", s.setupSave)
75 mux.HandleFunc("GET /settings", s.account)
76 mux.HandleFunc("POST /settings/tokens", s.createToken)
77 mux.HandleFunc("POST /settings/tokens/delete", s.deleteToken)
78 mux.HandleFunc("POST /settings/ssh", s.addSSH)
79 mux.HandleFunc("POST /settings/ssh/delete", s.deleteSSH)
80 mux.HandleFunc("GET /settings/export", s.export)
81 mux.HandleFunc("GET /groups/{path}", s.groupPage)
82 mux.HandleFunc("POST /groups/{path}/members", s.groupMember)
83 mux.HandleFunc("POST /groups/{path}/members/remove", s.groupMemberRemove)
84 mux.HandleFunc("POST /groups/{path}/secrets", s.groupSecret)
85 mux.HandleFunc("POST /groups/{path}/secrets/delete", s.groupSecretDelete)
86 mux.HandleFunc("POST /groups/{path}/webhooks", s.groupWebhook)
87 mux.HandleFunc("POST /groups/{path}/webhooks/delete", s.groupWebhookDelete)
88
89 mux.HandleFunc("GET /{owner}/{repo}/info/refs", s.gitHTTP)
90 mux.HandleFunc("POST /{owner}/{repo}/git-upload-pack", s.gitHTTP)
91 mux.HandleFunc("POST /{owner}/{repo}/git-receive-pack", s.gitHTTP)
92 mux.HandleFunc("POST /api/v1/repos/{owner}/{repo}/releases", s.createRelease)
93
94 mux.HandleFunc("GET /{owner}/{repo}", s.repoHome)
95 mux.HandleFunc("GET /{owner}/{repo}/-/tree/{path...}", s.tree)
96 mux.HandleFunc("GET /{owner}/{repo}/-/blob/{path...}", s.blob)
97 mux.HandleFunc("GET /{owner}/{repo}/-/commits", s.commits)
98 mux.HandleFunc("GET /{owner}/{repo}/-/commit/{sha}", s.commit)
99 mux.HandleFunc("GET /{owner}/{repo}/-/branches", s.branches)
100 mux.HandleFunc("GET /{owner}/{repo}/-/merge-requests", s.mergeRequests)
101 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests", s.createMR)
102 mux.HandleFunc("GET /{owner}/{repo}/-/merge-requests/{number}", s.showMR)
103 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests/{number}/merge", s.mergeMR)
104 mux.HandleFunc("POST /{owner}/{repo}/-/merge-requests/{number}/close", s.closeMR)
105 mux.HandleFunc("GET /{owner}/{repo}/-/pipelines", s.pipelines)
106 mux.HandleFunc("POST /{owner}/{repo}/-/pipelines", s.runPipeline)
107 mux.HandleFunc("GET /{owner}/{repo}/-/pipelines/{id}", s.pipeline)
108 mux.HandleFunc("GET /{owner}/{repo}/-/releases", s.releases)
109 mux.HandleFunc("GET /{owner}/{repo}/-/releases/{tag}/assets/{name}", s.releaseAsset)
110 mux.HandleFunc("GET /{owner}/{repo}/-/settings", s.settings)
111 mux.HandleFunc("POST /{owner}/{repo}/-/settings", s.updateRepo)
112 mux.HandleFunc("POST /{owner}/{repo}/-/members", s.repoMember)
113 mux.HandleFunc("POST /{owner}/{repo}/-/members/remove", s.repoMemberRemove)
114 mux.HandleFunc("POST /{owner}/{repo}/-/protected", s.addProtected)
115 mux.HandleFunc("POST /{owner}/{repo}/-/protected/remove", s.removeProtected)
116 mux.HandleFunc("POST /{owner}/{repo}/-/secrets", s.repoSecret)
117 mux.HandleFunc("POST /{owner}/{repo}/-/secrets/delete", s.repoSecretDelete)
118 mux.HandleFunc("POST /{owner}/{repo}/-/webhooks", s.repoWebhook)
119 mux.HandleFunc("POST /{owner}/{repo}/-/webhooks/delete", s.repoWebhookDelete)
120 mux.HandleFunc("POST /{owner}/{repo}/-/delete", s.deleteRepo)
121
122 return s.realIP(s.withSession(s.secure(s.gate(mux))))
123}
124
125func (s *Server) realIP(next http.Handler) http.Handler {
126 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
127 realip.Apply(r, s.Cfg.ProxySet())
128 next.ServeHTTP(w, r)
129 })
130}
131
132func (s *Server) mustTemplates() {
133 if s.tmpl != nil {
134 return
135 }
136 s.tmpl = template.Must(template.New("web").Funcs(template.FuncMap{
137 "short": func(v string) string {
138 if len(v) > 10 {
139 return v[:10]
140 }
141 return v
142 },
143 "join": strings.Join,
144 }).ParseFS(webFS, "templates/*.html"))
145}
146
147func (s *Server) asset(w http.ResponseWriter, r *http.Request) {
148 name := r.PathValue("file")
149 if name == "" || strings.Contains(name, "/") || strings.Contains(name, "..") {
150 http.NotFound(w, r)
151 return
152 }
153 sub, err := fs.Sub(webFS, "static")
154 if err != nil {
155 http.Error(w, "assets", http.StatusInternalServerError)
156 return
157 }
158 http.ServeFileFS(w, r, sub, name)
159}
160
161func (s *Server) secure(next http.Handler) http.Handler {
162 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
163 w.Header().Set("X-Content-Type-Options", "nosniff")
164 w.Header().Set("X-Frame-Options", "DENY")
165 w.Header().Set("Referrer-Policy", "strict-origin-when-cross-origin")
166 w.Header().Set("Content-Security-Policy", "default-src 'self'; img-src 'self' https://auth.timfalken.com data:; style-src 'self'; form-action 'self'; base-uri 'self'; frame-ancestors 'none'")
167 next.ServeHTTP(w, r)
168 })
169}
170
171func (s *Server) withSession(next http.Handler) http.Handler {
172 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
173 p := principal{}
174 if c, err := r.Cookie("bluegit_session"); err == nil && c.Value != "" {
175 sess, err := s.Store.Session(r.Context(), c.Value)
176 if err == nil && sess.ExpiresAt.After(time.Now()) {
177 p.Session = sess
178 p.User = sess.User
179 p.OK = true
180 s.maybeExtend(r.Context(), sess)
181 }
182 }
183 next.ServeHTTP(w, r.WithContext(context.WithValue(r.Context(), ctxKey{}, p)))
184 })
185}
186
187func (s *Server) maybeExtend(ctx context.Context, sess store.Session) {
188 if time.Until(sess.ExpiresAt) > 6*time.Hour {
189 return
190 }
191 sec, err := s.Auth.Extend(ctx, sess.AccessToken)
192 if err != nil || sec <= 0 {
193 return
194 }
195 _ = s.Store.UpdateSessionExpiry(ctx, sess.ID, time.Now().Add(time.Duration(sec)*time.Second))
196}
197
198func (s *Server) who(r *http.Request) principal {
199 p, _ := r.Context().Value(ctxKey{}).(principal)
200 return p
201}
202
203func (s *Server) csrfOK(w http.ResponseWriter, r *http.Request) bool {
204 if err := r.ParseForm(); err != nil {
205 http.Error(w, "ongeldig formulier", http.StatusBadRequest)
206 return false
207 }
208 p := s.who(r)
209 if !p.OK || r.FormValue("csrf") == "" || r.FormValue("csrf") != p.Session.CSRF {
210 http.Error(w, "ongeldig formulier, vernieuw de pagina", http.StatusBadRequest)
211 return false
212 }
213 return true
214}
215
216func (s *Server) loginRequired(w http.ResponseWriter, r *http.Request) (store.User, bool) {
217 p := s.who(r)
218 if !p.OK {
219 http.Redirect(w, r, "/login", http.StatusFound)
220 return store.User{}, false
221 }
222 return p.User, true
223}
224
225func (s *Server) setSessionCookie(w http.ResponseWriter, id string, exp time.Time) {
226 http.SetCookie(w, &http.Cookie{
227 Name: "bluegit_session",
228 Value: id,
229 Path: "/",
230 HttpOnly: true,
231 SameSite: http.SameSiteLaxMode,
232 Secure: strings.HasPrefix(s.Cfg.BaseURL, "https://"),
233 Expires: exp,
234 })
235}
236
237func (s *Server) flash(w http.ResponseWriter, notice, problem string) {
238 secure := strings.HasPrefix(s.Cfg.BaseURL, "https://")
239 if notice != "" {
240 http.SetCookie(w, &http.Cookie{Name: "bluegit_notice", Value: notice, Path: "/", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
241 }
242 if problem != "" {
243 http.SetCookie(w, &http.Cookie{Name: "bluegit_error", Value: problem, Path: "/", MaxAge: 120, HttpOnly: true, Secure: secure, SameSite: http.SameSiteLaxMode})
244 }
245}
246
247func (s *Server) takeFlash(w http.ResponseWriter, r *http.Request) (string, string) {
248 notice, problem := cookieVal(r, "bluegit_notice"), cookieVal(r, "bluegit_error")
249 if notice != "" {
250 http.SetCookie(w, &http.Cookie{Name: "bluegit_notice", Value: "", Path: "/", MaxAge: -1})
251 }
252 if problem != "" {
253 http.SetCookie(w, &http.Cookie{Name: "bluegit_error", Value: "", Path: "/", MaxAge: -1})
254 }
255 return notice, problem
256}
257
258func cookieVal(r *http.Request, name string) string {
259 c, err := r.Cookie(name)
260 if err != nil {
261 return ""
262 }
263 return c.Value
264}
265
266func (s *Server) redirect(w http.ResponseWriter, r *http.Request, path, notice, problem string) {
267 s.flash(w, notice, problem)
268 http.Redirect(w, r, path, http.StatusSeeOther)
269}
270
271func (s *Server) view(w http.ResponseWriter, r *http.Request, title string) View {
272 notice, problem := s.takeFlash(w, r)
273 v := View{Title: title, BaseURL: s.Cfg.BaseURL, Notice: notice, Err: problem, StorageUnset: s.StoragePath() == ""}
274 if p := s.who(r); p.OK {
275 u := p.User
276 v.User = &u
277 v.CSRF = p.Session.CSRF
278 }
279 return v
280}
281
282func (s *Server) render(w http.ResponseWriter, name string, v View) {
283 w.Header().Set("Content-Type", "text/html; charset=utf-8")
284 if err := s.tmpl.ExecuteTemplate(w, name, v); err != nil && s.Log != nil {
285 s.Log.Error("sjabloon", "name", name, "err", err)
286 }
287}
288
289func randomState() (string, error) {
290 b := make([]byte, 32)
291 if _, err := rand.Read(b); err != nil {
292 return "", err
293 }
294 return hex.EncodeToString(b), nil
295}
296
297// View is de gegevensset voor elk scherm.
298type View struct {
299 Title string
300 BaseURL string
301 User *store.User
302 CSRF string
303 Notice string
304 Err string
305 Repos []store.Repo
306 Groups []store.Group
307 Repo *store.Repo
308 Role access.Role
309 CanWrite bool
310 CanAdmin bool
311 CanMerge bool
312 Commits []CommitRow
313 Commit *CommitRow
314 Entries []EntryRow
315 TreePath string
316 Blob string
317 BlobPath string
318 Binary bool
319 Branches []BranchRow
320 MRs []store.MergeRequest
321 MR *store.MergeRequest
322 Diff string
323 Pipes []store.Pipeline
324 Pipe *store.Pipeline
325 Jobs []store.Job
326 Releases []store.Release
327 Members []store.Member
328 Secrets []store.SecretMeta
329 Hooks []HookView
330 Patterns []string
331 Tokens []store.TokenInfo
332 Keys []store.SSHKey
333 CloneHTTP string
334 CloneSSH string
335 Group *store.Group
336 Tab string
337 Rev string
338 NewToken string
339 StorageUnset bool
340 StoragePath string
341 StorageFree string
342 StorageTotal string
343 MinFree string
344}
345
346// CommitRow is een commit in de interface.
347type CommitRow struct {
348 SHA, Short, Author, Date, Subject, Body string
349}
350
351// EntryRow is een bestand of map.
352type EntryRow struct {
353 Name, Type, Path string
354}
355
356// BranchRow is een branch, met of zonder bescherming.
357type BranchRow struct {
358 Name string
359 Protected bool
360}
361
362// HookView is een webhook plus de laatste pogingen.
363type HookView struct {
364 ID int64
365 Name string
366 Preset string
367 URL string
368 Filter string
369 Events string
370 Deliveries []store.Delivery
371}
372
373func repoURL(repo store.Repo) string { return "/" + repo.FullPath() }
internal/server/server_test.go added +347 −0
@@ -0,0 +1,347 @@
1 package server
2
3 import (
4 "context"
5 "io"
6 "net/http"
7 "net/http/cookiejar"
8 "net/http/httptest"
9 "net/url"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14 "testing"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/auth"
18 "gitlab.com/Timfa/bluegit/internal/config"
19 "gitlab.com/Timfa/bluegit/internal/store"
20 )
21
22 func TestWebRepoPushAndSecretBoundary(t *testing.T) {
23 if _, err := exec.LookPath("git"); err != nil {
24 t.Skip("git ontbreekt")
25 }
26 storage := t.TempDir()
27 key := bytes32()
28 st, err := store.Open(filepath.Join(storage, "bluegit.db"), key)
29 if err != nil {
30 t.Fatal(err)
31 }
32 t.Cleanup(func() { _ = st.Close() })
33 cfg := config.Config{
34 BaseURL: "http://127.0.0.1:9", Listen: "127.0.0.1:0", StoragePath: storage,
35 Auth: config.Auth{Mode: "dev", DevUser: "tim", DevAuthID: 1, UserAgent: "test"},
36 Git: config.Git{Binary: "git", DefaultBranch: "master"},
37 SSH: config.SSH{Enabled: true, Listen: "0.0.0.0:2222", PublicHost: "git.timfalken.com", PublicPort: 22},
38 CI: config.CI{Enabled: false},
39 }
40 cfg.Auth.BaseURL = "https://auth.timfalken.com"
41 srv := &Server{Cfg: cfg, Store: st, Auth: auth.Dev{Username: "tim", AuthID: 1}, Dev: true, Git: "git", HookBin: "/bin/true"}
42 ts := httptest.NewServer(srv.Handler())
43 t.Cleanup(ts.Close)
44
45 jar, _ := cookiejar.New(nil)
46 client := &http.Client{Jar: jar}
47 res, err := client.Get(ts.URL + "/login")
48 if err != nil {
49 t.Fatal(err)
50 }
51 body := read(t, res)
52 if res.StatusCode != 200 || !strings.Contains(body, "Overzicht") {
53 t.Fatalf("login %d %s", res.StatusCode, body)
54 }
55 logo, err := client.Get(ts.URL + "/assets/logo.svg")
56 if err != nil {
57 t.Fatal(err)
58 }
59 wantLogo, err := os.ReadFile("../../assets/logo.svg")
60 if err != nil {
61 t.Fatal(err)
62 }
63 if logo.StatusCode != 200 || read(t, logo) != string(wantLogo) {
64 t.Fatalf("logo %d wijkt af van assets/logo.svg", logo.StatusCode)
65 }
66 if ct := logo.Header.Get("Content-Type"); !strings.Contains(ct, "image/svg+xml") {
67 t.Fatalf("favicon-type %s", ct)
68 }
69 csrf := csrfOf(t, body)
70 form := url.Values{"csrf": {csrf}, "name": {"demo"}, "description": {"eerste"}, "visibility": {"private"}}
71 res, err = client.PostForm(ts.URL+"/new/repo", form)
72 if err != nil {
73 t.Fatal(err)
74 }
75 body = read(t, res)
76 if !strings.Contains(body, "tim/demo") {
77 t.Fatalf("repo pagina:\n%s", body)
78 }
79 if !strings.Contains(body, "ssh://git@git.timfalken.com:22/tim/demo.git") {
80 t.Fatalf("clone-URL hoort de publieke SSH-poort te tonen:\n%s", body)
81 }
82 if strings.Contains(body, ":2222/") {
83 t.Fatalf("clone-URL toont de bindpoort:\n%s", body)
84 }
85
86 res, err = client.PostForm(ts.URL+"/settings/tokens", url.Values{"csrf": {csrfOf(t, body)}, "name": {"test"}})
87 if err != nil {
88 t.Fatal(err)
89 }
90 body = read(t, res)
91 token := between(body, `<p class="code">`, "</p>")
92 if !strings.HasPrefix(token, "bg_") {
93 t.Fatalf("token pagina:\n%s", body)
94 }
95
96 work := t.TempDir()
97 git(t, work, "init", "-b", "master")
98 git(t, work, "config", "user.email", "tim@users.git.timfalken.com")
99 git(t, work, "config", "user.name", "tim")
100 if err := os.WriteFile(filepath.Join(work, "README.md"), []byte("hallo bluegit\n"), 0o644); err != nil {
101 t.Fatal(err)
102 }
103 git(t, work, "add", "README.md")
104 git(t, work, "commit", "-m", "eerste commit")
105 remote := strings.Replace(ts.URL, "http://", "http://tim:"+token+"@", 1) + "/tim/demo.git"
106 git(t, work, "remote", "add", "origin", remote)
107 git(t, work, "push", "-u", "origin", "master")
108
109 res, err = client.Get(ts.URL + "/tim/demo")
110 if err != nil {
111 t.Fatal(err)
112 }
113 body = read(t, res)
114 if !strings.Contains(body, "eerste commit") || !strings.Contains(body, "README.md") {
115 t.Fatalf("na push:\n%s", body)
116 }
117 res, err = client.Get(ts.URL + "/tim/demo/-/blob/README.md")
118 if err != nil {
119 t.Fatal(err)
120 }
121 body = read(t, res)
122 if !strings.Contains(body, "hallo bluegit") {
123 t.Fatalf("blob:\n%s", body)
124 }
125
126 ctx := context.Background()
127 ada, err := st.UpsertUser(ctx, 2, "ada", "", false)
128 if err != nil {
129 t.Fatal(err)
130 }
131 repo, err := st.RepoByPath(ctx, "tim", "demo")
132 if err != nil {
133 t.Fatal(err)
134 }
135 if err := st.SetMember(ctx, "repo", repo.ID, "ada", "developer"); err != nil {
136 t.Fatal(err)
137 }
138 sess, err := st.CreateSession(ctx, ada.ID, "dev", time.Now().Add(time.Hour))
139 if err != nil {
140 t.Fatal(err)
141 }
142 adaJar, _ := cookiejar.New(nil)
143 adaClient := &http.Client{Jar: adaJar}
144 u, _ := url.Parse(ts.URL)
145 adaJar.SetCookies(u, []*http.Cookie{{Name: "bluegit_session", Value: sess.ID, Path: "/"}})
146 res, err = adaClient.Get(ts.URL + "/")
147 if err != nil {
148 t.Fatal(err)
149 }
150 adaCSRF := csrfOf(t, read(t, res))
151 res, err = adaClient.PostForm(ts.URL+"/tim/demo/-/secrets", url.Values{
152 "csrf": {adaCSRF}, "name": {"TOKEN"}, "value": {"super-geheim-waarde"},
153 })
154 if err != nil {
155 t.Fatal(err)
156 }
157 if res.StatusCode != http.StatusForbidden {
158 t.Fatalf("ontwikkelaar mocht een geheim schrijven: %d", res.StatusCode)
159 }
160 _ = res.Body.Close()
161
162 res, err = client.Get(ts.URL + "/tim/demo/-/settings?tab=geheimen")
163 if err != nil {
164 t.Fatal(err)
165 }
166 ownerPage := read(t, res)
167 res, err = client.PostForm(ts.URL+"/tim/demo/-/secrets", url.Values{
168 "csrf": {csrfOf(t, ownerPage)}, "name": {"TOKEN"}, "value": {"super-geheim-waarde"},
169 })
170 if err != nil {
171 t.Fatal(err)
172 }
173 saved := read(t, res)
174 if strings.Contains(saved, "super-geheim-waarde") {
175 t.Fatal("geheimwaarde staat op de pagina")
176 }
177 if !strings.Contains(saved, "TOKEN") {
178 t.Fatalf("naam ontbreekt:\n%s", saved)
179 }
180
181 res, err = client.PostForm(ts.URL+"/tim/demo/-/webhooks", url.Values{
182 "csrf": {csrfOf(t, saved)}, "name": {"kapot"}, "preset": {"generic"},
183 "url": {"https://example.test/hook"}, "branch_filter": {"re:("}, "event_push": {"1"},
184 })
185 if err != nil {
186 t.Fatal(err)
187 }
188 hookPage := read(t, res)
189 if !strings.Contains(hookPage, "branchfilter") && !strings.Contains(hookPage, "error") && !strings.Contains(strings.ToLower(hookPage), "regex") {
190 t.Fatalf("kapot filter:\n%s", hookPage)
191 }
192 }
193
194 func TestSetupChoosesStorage(t *testing.T) {
195 storage := t.TempDir()
196 stateDir := t.TempDir()
197 key := bytes32()
198 st, err := store.Open(filepath.Join(stateDir, "bluegit.db"), key)
199 if err != nil {
200 t.Fatal(err)
201 }
202 t.Cleanup(func() { _ = st.Close() })
203 cfg := config.Config{
204 BaseURL: "http://127.0.0.1:9", Listen: "127.0.0.1:0",
205 Auth: config.Auth{Mode: "dev", DevUser: "tim", DevAuthID: 1, UserAgent: "test"},
206 Git: config.Git{Binary: "git", DefaultBranch: "master"},
207 }
208 srv := &Server{Cfg: cfg, Store: st, Auth: auth.Dev{Username: "tim", AuthID: 1}, Dev: true, Git: "git", HookBin: "/bin/true", StateDir: stateDir}
209 ts := httptest.NewServer(srv.Handler())
210 t.Cleanup(ts.Close)
211
212 res, err := http.Get(ts.URL + "/tim/demo.git/info/refs?service=git-upload-pack")
213 if err != nil {
214 t.Fatal(err)
215 }
216 body := read(t, res)
217 if res.StatusCode != http.StatusServiceUnavailable || !strings.Contains(body, "nog niet ingesteld") {
218 t.Fatalf("git zonder opslag: %d %s", res.StatusCode, body)
219 }
220
221 jar, _ := cookiejar.New(nil)
222 client := &http.Client{Jar: jar}
223 res, err = client.Get(ts.URL + "/login")
224 if err != nil {
225 t.Fatal(err)
226 }
227 page := read(t, res)
228 if res.StatusCode != 200 || !strings.Contains(page, "Opslag kiezen") {
229 t.Fatalf("setup:\n%s", page)
230 }
231 res, err = client.PostForm(ts.URL+"/setup", url.Values{"csrf": {csrfOf(t, page)}, "path": {"relatief"}})
232 if err != nil {
233 t.Fatal(err)
234 }
235 page = read(t, res)
236 if !strings.Contains(page, "absoluut") {
237 t.Fatalf("relatief pad:\n%s", page)
238 }
239 res, err = client.PostForm(ts.URL+"/setup", url.Values{"csrf": {csrfOf(t, page)}, "path": {storage}})
240 if err != nil {
241 t.Fatal(err)
242 }
243 page = read(t, res)
244 if !strings.Contains(page, "Overzicht") || !strings.Contains(page, "vrij") {
245 t.Fatalf("na opslaan:\n%s", page)
246 }
247 if srv.StoragePath() != storage {
248 t.Fatalf("pad %s", srv.StoragePath())
249 }
250 saved, err := os.ReadFile(filepath.Join(stateDir, "storage_path"))
251 if err != nil || strings.TrimSpace(string(saved)) != storage {
252 t.Fatalf("bestand %q %v", saved, err)
253 }
254 res, err = client.Get(ts.URL + "/setup")
255 if err != nil {
256 t.Fatal(err)
257 }
258 page = read(t, res)
259 if !strings.Contains(page, "verplaatst geen") || !strings.Contains(page, "Vrije ruimte") {
260 t.Fatalf("wijzigen:\n%s", page)
261 }
262 res, err = http.Get(ts.URL + "/tim/demo.git/info/refs?service=git-upload-pack")
263 if err != nil {
264 t.Fatal(err)
265 }
266 body = read(t, res)
267 if res.StatusCode == http.StatusServiceUnavailable {
268 t.Fatalf("git blijft geblokkeerd: %s", body)
269 }
270
271 ada, err := st.UpsertUser(context.Background(), 2, "ada", "", true)
272 if err != nil {
273 t.Fatal(err)
274 }
275 if ada.InstanceAdmin {
276 t.Fatal("is_admin werd installatiebeheerder")
277 }
278 sess, err := st.CreateSession(context.Background(), ada.ID, "dev", time.Now().Add(time.Hour))
279 if err != nil {
280 t.Fatal(err)
281 }
282 adaJar, _ := cookiejar.New(nil)
283 adaClient := &http.Client{Jar: adaJar}
284 u, _ := url.Parse(ts.URL)
285 adaJar.SetCookies(u, []*http.Cookie{{Name: "bluegit_session", Value: sess.ID, Path: "/"}})
286 res, err = adaClient.Get(ts.URL + "/setup")
287 if err != nil {
288 t.Fatal(err)
289 }
290 if res.StatusCode != http.StatusForbidden {
291 t.Fatalf("ada setup %d %s", res.StatusCode, read(t, res))
292 }
293 _ = res.Body.Close()
294 }
295
296 func csrfOf(t *testing.T, body string) string {
297 t.Helper()
298 const needle = `name="csrf" value="`
299 i := strings.Index(body, needle)
300 if i < 0 {
301 t.Fatalf("geen csrf in\n%s", body)
302 }
303 rest := body[i+len(needle):]
304 j := strings.Index(rest, `"`)
305 return rest[:j]
306 }
307
308 func between(s, a, b string) string {
309 i := strings.Index(s, a)
310 if i < 0 {
311 return ""
312 }
313 rest := s[i+len(a):]
314 j := strings.Index(rest, b)
315 if j < 0 {
316 return ""
317 }
318 return rest[:j]
319 }
320
321 func read(t *testing.T, res *http.Response) string {
322 t.Helper()
323 defer res.Body.Close()
324 b, err := io.ReadAll(res.Body)
325 if err != nil {
326 t.Fatal(err)
327 }
328 return string(b)
329 }
330
331 func git(t *testing.T, dir string, args ...string) {
332 t.Helper()
333 cmd := exec.Command("git", args...)
334 cmd.Dir = dir
335 out, err := cmd.CombinedOutput()
336 if err != nil {
337 t.Fatalf("git %s: %v\n%s", strings.Join(args, " "), err, out)
338 }
339 }
340
341 func bytes32() []byte {
342 b := make([]byte, 32)
343 for i := range b {
344 b[i] = byte(i + 3)
345 }
346 return b
347 }
@@ -0,0 +1,347 @@
1package server
2
3import (
4 "context"
5 "io"
6 "net/http"
7 "net/http/cookiejar"
8 "net/http/httptest"
9 "net/url"
10 "os"
11 "os/exec"
12 "path/filepath"
13 "strings"
14 "testing"
15 "time"
16
17 "gitlab.com/Timfa/bluegit/internal/auth"
18 "gitlab.com/Timfa/bluegit/internal/config"
19 "gitlab.com/Timfa/bluegit/internal/store"
20)
21
22func TestWebRepoPushAndSecretBoundary(t *testing.T) {
23 if _, err := exec.LookPath("git"); err != nil {
24 t.Skip("git ontbreekt")
25 }
26 storage := t.TempDir()
27 key := bytes32()
28 st, err := store.Open(filepath.Join(storage, "bluegit.db"), key)
29 if err != nil {
30 t.Fatal(err)
31 }
32 t.Cleanup(func() { _ = st.Close() })
33 cfg := config.Config{
34 BaseURL: "http://127.0.0.1:9", Listen: "127.0.0.1:0", StoragePath: storage,
35 Auth: config.Auth{Mode: "dev", DevUser: "tim", DevAuthID: 1, UserAgent: "test"},
36 Git: config.Git{Binary: "git", DefaultBranch: "master"},
37 SSH: config.SSH{Enabled: true, Listen: "0.0.0.0:2222", PublicHost: "git.timfalken.com", PublicPort: 22},
38 CI: config.CI{Enabled: false},
39 }
40 cfg.Auth.BaseURL = "https://auth.timfalken.com"
41 srv := &Server{Cfg: cfg, Store: st, Auth: auth.Dev{Username: "tim", AuthID: 1}, Dev: true, Git: "git", HookBin: "/bin/true"}
42 ts := httptest.NewServer(srv.Handler())
43 t.Cleanup(ts.Close)
44
45 jar, _ := cookiejar.New(nil)
46 client := &http.Client{Jar: jar}
47 res, err := client.Get(ts.URL + "/login")
48 if err != nil {
49 t.Fatal(err)
50 }
51 body := read(t, res)
52 if res.StatusCode != 200 || !strings.Contains(body, "Overzicht") {
53 t.Fatalf("login %d %s", res.StatusCode, body)
54 }
55 logo, err := client.Get(ts.URL + "/assets/logo.svg")
56 if err != nil {
57 t.Fatal(err)
58 }
59 wantLogo, err := os.ReadFile("../../assets/logo.svg")
60 if err != nil {
61 t.Fatal(err)
62 }
63 if logo.StatusCode != 200 || read(t, logo) != string(wantLogo) {
64 t.Fatalf("logo %d wijkt af van assets/logo.svg", logo.StatusCode)
65 }
66 if ct := logo.Header.Get("Content-Type"); !strings.Contains(ct, "image/svg+xml") {
67 t.Fatalf("favicon-type %s", ct)
68 }
69 csrf := csrfOf(t, body)
70 form := url.Values{"csrf": {csrf}, "name": {"demo"}, "description": {"eerste"}, "visibility": {"private"}}
71 res, err = client.PostForm(ts.URL+"/new/repo", form)
72 if err != nil {
73 t.Fatal(err)
74 }
75 body = read(t, res)
76 if !strings.Contains(body, "tim/demo") {
77 t.Fatalf("repo pagina:\n%s", body)
78 }
79 if !strings.Contains(body, "ssh://git@git.timfalken.com:22/tim/demo.git") {
80 t.Fatalf("clone-URL hoort de publieke SSH-poort te tonen:\n%s", body)
81 }
82 if strings.Contains(body, ":2222/") {
83 t.Fatalf("clone-URL toont de bindpoort:\n%s", body)
84 }
85
86 res, err = client.PostForm(ts.URL+"/settings/tokens", url.Values{"csrf": {csrfOf(t, body)}, "name": {"test"}})
87 if err != nil {
88 t.Fatal(err)
89 }
90 body = read(t, res)
91 token := between(body, `<p class="code">`, "</p>")
92 if !strings.HasPrefix(token, "bg_") {
93 t.Fatalf("token pagina:\n%s", body)
94 }
95
96 work := t.TempDir()
97 git(t, work, "init", "-b", "master")
98 git(t, work, "config", "user.email", "tim@users.git.timfalken.com")
99 git(t, work, "config", "user.name", "tim")
100 if err := os.WriteFile(filepath.Join(work, "README.md"), []byte("hallo bluegit\n"), 0o644); err != nil {
101 t.Fatal(err)
102 }
103 git(t, work, "add", "README.md")
104 git(t, work, "commit", "-m", "eerste commit")
105 remote := strings.Replace(ts.URL, "http://", "http://tim:"+token+"@", 1) + "/tim/demo.git"
106 git(t, work, "remote", "add", "origin", remote)
107 git(t, work, "push", "-u", "origin", "master")
108
109 res, err = client.Get(ts.URL + "/tim/demo")
110 if err != nil {
111 t.Fatal(err)
112 }
113 body = read(t, res)
114 if !strings.Contains(body, "eerste commit") || !strings.Contains(body, "README.md") {
115 t.Fatalf("na push:\n%s", body)
116 }
117 res, err = client.Get(ts.URL + "/tim/demo/-/blob/README.md")
118 if err != nil {
119 t.Fatal(err)
120 }
121 body = read(t, res)
122 if !strings.Contains(body, "hallo bluegit") {
123 t.Fatalf("blob:\n%s", body)
124 }
125
126 ctx := context.Background()
127 ada, err := st.UpsertUser(ctx, 2, "ada", "", false)
128 if err != nil {
129 t.Fatal(err)
130 }
131 repo, err := st.RepoByPath(ctx, "tim", "demo")
132 if err != nil {
133 t.Fatal(err)
134 }
135 if err := st.SetMember(ctx, "repo", repo.ID, "ada", "developer"); err != nil {
136 t.Fatal(err)
137 }
138 sess, err := st.CreateSession(ctx, ada.ID, "dev", time.Now().Add(time.Hour))
139 if err != nil {
140 t.Fatal(err)
141 }
142 adaJar, _ := cookiejar.New(nil)
143 adaClient := &http.Client{Jar: adaJar}
144 u, _ := url.Parse(ts.URL)
145 adaJar.SetCookies(u, []*http.Cookie{{Name: "bluegit_session", Value: sess.ID, Path: "/"}})
146 res, err = adaClient.Get(ts.URL + "/")
147 if err != nil {
148 t.Fatal(err)
149 }
150 adaCSRF := csrfOf(t, read(t, res))
151 res, err = adaClient.PostForm(ts.URL+"/tim/demo/-/secrets", url.Values{
152 "csrf": {adaCSRF}, "name": {"TOKEN"}, "value": {"super-geheim-waarde"},
153 })
154 if err != nil {
155 t.Fatal(err)
156 }
157 if res.StatusCode != http.StatusForbidden {
158 t.Fatalf("ontwikkelaar mocht een geheim schrijven: %d", res.StatusCode)
159 }
160 _ = res.Body.Close()
161
162 res, err = client.Get(ts.URL + "/tim/demo/-/settings?tab=geheimen")
163 if err != nil {
164 t.Fatal(err)
165 }
166 ownerPage := read(t, res)
167 res, err = client.PostForm(ts.URL+"/tim/demo/-/secrets", url.Values{
168 "csrf": {csrfOf(t, ownerPage)}, "name": {"TOKEN"}, "value": {"super-geheim-waarde"},
169 })
170 if err != nil {
171 t.Fatal(err)
172 }
173 saved := read(t, res)
174 if strings.Contains(saved, "super-geheim-waarde") {
175 t.Fatal("geheimwaarde staat op de pagina")
176 }
177 if !strings.Contains(saved, "TOKEN") {
178 t.Fatalf("naam ontbreekt:\n%s", saved)
179 }
180
181 res, err = client.PostForm(ts.URL+"/tim/demo/-/webhooks", url.Values{
182 "csrf": {csrfOf(t, saved)}, "name": {"kapot"}, "preset": {"generic"},
183 "url": {"https://example.test/hook"}, "branch_filter": {"re:("}, "event_push": {"1"},
184 })
185 if err != nil {
186 t.Fatal(err)
187 }
188 hookPage := read(t, res)
189 if !strings.Contains(hookPage, "branchfilter") && !strings.Contains(hookPage, "error") && !strings.Contains(strings.ToLower(hookPage), "regex") {
190 t.Fatalf("kapot filter:\n%s", hookPage)
191 }
192}
193
194func TestSetupChoosesStorage(t *testing.T) {
195 storage := t.TempDir()
196 stateDir := t.TempDir()
197 key := bytes32()
198 st, err := store.Open(filepath.Join(stateDir, "bluegit.db"), key)
199 if err != nil {
200 t.Fatal(err)
201 }
202 t.Cleanup(func() { _ = st.Close() })
203 cfg := config.Config{
204 BaseURL: "http://127.0.0.1:9", Listen: "127.0.0.1:0",
205 Auth: config.Auth{Mode: "dev", DevUser: "tim", DevAuthID: 1, UserAgent: "test"},
206 Git: config.Git{Binary: "git", DefaultBranch: "master"},
207 }
208 srv := &Server{Cfg: cfg, Store: st, Auth: auth.Dev{Username: "tim", AuthID: 1}, Dev: true, Git: "git", HookBin: "/bin/true", StateDir: stateDir}
209 ts := httptest.NewServer(srv.Handler())
210 t.Cleanup(ts.Close)
211
212 res, err := http.Get(ts.URL + "/tim/demo.git/info/refs?service=git-upload-pack")
213 if err != nil {
214 t.Fatal(err)
215 }
216 body := read(t, res)
217 if res.StatusCode != http.StatusServiceUnavailable || !strings.Contains(body, "nog niet ingesteld") {
218 t.Fatalf("git zonder opslag: %d %s", res.StatusCode, body)
219 }
220
221 jar, _ := cookiejar.New(nil)
222 client := &http.Client{Jar: jar}
223 res, err = client.Get(ts.URL + "/login")
224 if err != nil {
225 t.Fatal(err)
226 }
227 page := read(t, res)
228 if res.StatusCode != 200 || !strings.Contains(page, "Opslag kiezen") {
229 t.Fatalf("setup:\n%s", page)
230 }
231 res, err = client.PostForm(ts.URL+"/setup", url.Values{"csrf": {csrfOf(t, page)}, "path": {"relatief"}})
232 if err != nil {
233 t.Fatal(err)
234 }
235 page = read(t, res)
236 if !strings.Contains(page, "absoluut") {
237 t.Fatalf("relatief pad:\n%s", page)
238 }
239 res, err = client.PostForm(ts.URL+"/setup", url.Values{"csrf": {csrfOf(t, page)}, "path": {storage}})
240 if err != nil {
241 t.Fatal(err)
242 }
243 page = read(t, res)
244 if !strings.Contains(page, "Overzicht") || !strings.Contains(page, "vrij") {
245 t.Fatalf("na opslaan:\n%s", page)
246 }
247 if srv.StoragePath() != storage {
248 t.Fatalf("pad %s", srv.StoragePath())
249 }
250 saved, err := os.ReadFile(filepath.Join(stateDir, "storage_path"))
251 if err != nil || strings.TrimSpace(string(saved)) != storage {
252 t.Fatalf("bestand %q %v", saved, err)
253 }
254 res, err = client.Get(ts.URL + "/setup")
255 if err != nil {
256 t.Fatal(err)
257 }
258 page = read(t, res)
259 if !strings.Contains(page, "verplaatst geen") || !strings.Contains(page, "Vrije ruimte") {
260 t.Fatalf("wijzigen:\n%s", page)
261 }
262 res, err = http.Get(ts.URL + "/tim/demo.git/info/refs?service=git-upload-pack")
263 if err != nil {
264 t.Fatal(err)
265 }
266 body = read(t, res)
267 if res.StatusCode == http.StatusServiceUnavailable {
268 t.Fatalf("git blijft geblokkeerd: %s", body)
269 }
270
271 ada, err := st.UpsertUser(context.Background(), 2, "ada", "", true)
272 if err != nil {
273 t.Fatal(err)
274 }
275 if ada.InstanceAdmin {
276 t.Fatal("is_admin werd installatiebeheerder")
277 }
278 sess, err := st.CreateSession(context.Background(), ada.ID, "dev", time.Now().Add(time.Hour))
279 if err != nil {
280 t.Fatal(err)
281 }
282 adaJar, _ := cookiejar.New(nil)
283 adaClient := &http.Client{Jar: adaJar}
284 u, _ := url.Parse(ts.URL)
285 adaJar.SetCookies(u, []*http.Cookie{{Name: "bluegit_session", Value: sess.ID, Path: "/"}})
286 res, err = adaClient.Get(ts.URL + "/setup")
287 if err != nil {
288 t.Fatal(err)
289 }
290 if res.StatusCode != http.StatusForbidden {
291 t.Fatalf("ada setup %d %s", res.StatusCode, read(t, res))
292 }
293 _ = res.Body.Close()
294}
295
296func csrfOf(t *testing.T, body string) string {
297 t.Helper()
298 const needle = `name="csrf" value="`
299 i := strings.Index(body, needle)
300 if i < 0 {
301 t.Fatalf("geen csrf in\n%s", body)
302 }
303 rest := body[i+len(needle):]
304 j := strings.Index(rest, `"`)
305 return rest[:j]
306}
307
308func between(s, a, b string) string {
309 i := strings.Index(s, a)
310 if i < 0 {
311 return ""
312 }
313 rest := s[i+len(a):]
314 j := strings.Index(rest, b)
315 if j < 0 {
316 return ""
317 }
318 return rest[:j]
319}
320
321func read(t *testing.T, res *http.Response) string {
322 t.Helper()
323 defer res.Body.Close()
324 b, err := io.ReadAll(res.Body)
325 if err != nil {
326 t.Fatal(err)
327 }
328 return string(b)
329}
330
331func git(t *testing.T, dir string, args ...string) {
332 t.Helper()
333 cmd := exec.Command("git", args...)
334 cmd.Dir = dir
335 out, err := cmd.CombinedOutput()
336 if err != nil {
337 t.Fatalf("git %s: %v\n%s", strings.Join(args, " "), err, out)
338 }
339}
340
341func bytes32() []byte {
342 b := make([]byte, 32)
343 for i := range b {
344 b[i] = byte(i + 3)
345 }
346 return b
347}
internal/server/settings_handlers.go added +331 −0
@@ -0,0 +1,331 @@
1 package server
2
3 import (
4 "net/http"
5 "os"
6 "strconv"
7 "strings"
8
9 "gitlab.com/Timfa/bluegit/internal/access"
10 "gitlab.com/Timfa/bluegit/internal/gitrepo"
11 "gitlab.com/Timfa/bluegit/internal/store"
12 "gitlab.com/Timfa/bluegit/internal/webhook"
13 )
14
15 func (s *Server) settings(w http.ResponseWriter, r *http.Request) {
16 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
17 if !ok {
18 return
19 }
20 v := s.repoView(w, r, repo, role, "Instellingen")
21 v.Tab = r.URL.Query().Get("tab")
22 if v.Tab == "" {
23 v.Tab = "algemeen"
24 }
25 if role.CanManageSettings() {
26 v.Members, _ = s.Store.ListMembers(r.Context(), "repo", repo.ID)
27 if repo.OwnerKind == "user" {
28 owner, err := s.Store.UserByID(r.Context(), repo.OwnerID)
29 if err == nil {
30 v.Members = append([]store.Member{{UserID: owner.ID, Username: owner.Username, Role: access.RoleMaintainer}}, v.Members...)
31 }
32 }
33 v.Secrets, _ = s.Store.ListSecrets(r.Context(), "repo", repo.ID)
34 v.Patterns, _ = s.Store.ProtectedPatterns(r.Context(), repo.ID)
35 v.Hooks = s.hookViews(r, "repo", repo.ID)
36 }
37 s.render(w, "settings", v)
38 }
39
40 func (s *Server) hookViews(r *http.Request, kind string, id int64) []HookView {
41 hooks, err := s.Store.ListWebhooks(r.Context(), kind, id)
42 if err != nil {
43 return nil
44 }
45 var out []HookView
46 for _, h := range hooks {
47 d, _ := s.Store.RecentDeliveries(r.Context(), h.ID)
48 out = append(out, HookView{
49 ID: h.ID, Name: h.Name, Preset: h.Preset, URL: h.URLTemplate,
50 Filter: h.BranchFilter, Events: strings.Join(h.Events, ", "), Deliveries: d,
51 })
52 }
53 return out
54 }
55
56 func (s *Server) updateRepo(w http.ResponseWriter, r *http.Request) {
57 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
58 if !ok || !s.csrfOK(w, r) {
59 return
60 }
61 vis := r.FormValue("visibility")
62 if vis != "public" {
63 vis = "private"
64 }
65 if err := s.Store.UpdateRepo(r.Context(), repo.ID, r.FormValue("description"), vis); err != nil {
66 s.redirect(w, r, repoURL(repo)+"/-/settings", "", err.Error())
67 return
68 }
69 s.redirect(w, r, repoURL(repo)+"/-/settings", "Opgeslagen", "")
70 }
71
72 func (s *Server) repoMember(w http.ResponseWriter, r *http.Request) {
73 s.memberPost(w, r, "repo")
74 }
75
76 func (s *Server) repoMemberRemove(w http.ResponseWriter, r *http.Request) {
77 s.memberRemove(w, r, "repo")
78 }
79
80 func (s *Server) groupMember(w http.ResponseWriter, r *http.Request) {
81 s.memberPost(w, r, "group")
82 }
83
84 func (s *Server) groupMemberRemove(w http.ResponseWriter, r *http.Request) {
85 s.memberRemove(w, r, "group")
86 }
87
88 func (s *Server) memberPost(w http.ResponseWriter, r *http.Request, kind string) {
89 scopeID, back, ok := s.adminScope(w, r, kind)
90 if !ok || !s.csrfOK(w, r) {
91 return
92 }
93 role, err := access.ParseRole(r.FormValue("role"))
94 if err != nil {
95 s.redirect(w, r, back, "", err.Error())
96 return
97 }
98 if err := s.Store.SetMember(r.Context(), kind, scopeID, r.FormValue("username"), role); err != nil {
99 s.redirect(w, r, back, "", err.Error())
100 return
101 }
102 s.redirect(w, r, back, "Lid opgeslagen", "")
103 }
104
105 func (s *Server) memberRemove(w http.ResponseWriter, r *http.Request, kind string) {
106 scopeID, back, ok := s.adminScope(w, r, kind)
107 if !ok || !s.csrfOK(w, r) {
108 return
109 }
110 if err := s.Store.RemoveMember(r.Context(), kind, scopeID, r.FormValue("username")); err != nil {
111 s.redirect(w, r, back, "", err.Error())
112 return
113 }
114 s.redirect(w, r, back, "Lid verwijderd", "")
115 }
116
117 func (s *Server) adminScope(w http.ResponseWriter, r *http.Request, kind string) (int64, string, bool) {
118 if kind == "group" {
119 g, role, ok := s.guardGroup(w, r, access.RoleMaintainer)
120 if !ok {
121 return 0, "", false
122 }
123 _ = role
124 return g.ID, "/groups/" + g.Path, true
125 }
126 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
127 if !ok {
128 return 0, "", false
129 }
130 return repo.ID, repoURL(repo) + "/-/settings?tab=leden", true
131 }
132
133 func (s *Server) addProtected(w http.ResponseWriter, r *http.Request) {
134 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
135 if !ok || !s.csrfOK(w, r) {
136 return
137 }
138 if err := s.Store.AddProtected(r.Context(), repo.ID, r.FormValue("pattern")); err != nil {
139 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "", err.Error())
140 return
141 }
142 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "Branch beschermd", "")
143 }
144
145 func (s *Server) removeProtected(w http.ResponseWriter, r *http.Request) {
146 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
147 if !ok || !s.csrfOK(w, r) {
148 return
149 }
150 _ = s.Store.RemoveProtected(r.Context(), repo.ID, r.FormValue("pattern"))
151 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "Patroon verwijderd", "")
152 }
153
154 func (s *Server) repoSecret(w http.ResponseWriter, r *http.Request) {
155 s.secretPost(w, r, "repo")
156 }
157 func (s *Server) repoSecretDelete(w http.ResponseWriter, r *http.Request) {
158 s.secretDelete(w, r, "repo")
159 }
160 func (s *Server) groupSecret(w http.ResponseWriter, r *http.Request) {
161 s.secretPost(w, r, "group")
162 }
163 func (s *Server) groupSecretDelete(w http.ResponseWriter, r *http.Request) {
164 s.secretDelete(w, r, "group")
165 }
166
167 func (s *Server) secretPost(w http.ResponseWriter, r *http.Request, kind string) {
168 scopeID, back, ok := s.adminScope(w, r, kind)
169 if !ok || !s.csrfOK(w, r) {
170 return
171 }
172 back = strings.Split(back, "?")[0]
173 if kind == "repo" {
174 back += "?tab=geheimen"
175 }
176 if err := s.Store.PutSecret(r.Context(), kind, scopeID, strings.TrimSpace(r.FormValue("name")), r.FormValue("value"), r.FormValue("protected") == "1"); err != nil {
177 s.redirect(w, r, back, "", err.Error())
178 return
179 }
180 s.redirect(w, r, back, "Geheim opgeslagen", "")
181 }
182
183 func (s *Server) secretDelete(w http.ResponseWriter, r *http.Request, kind string) {
184 scopeID, back, ok := s.adminScope(w, r, kind)
185 if !ok || !s.csrfOK(w, r) {
186 return
187 }
188 back = strings.Split(back, "?")[0]
189 if kind == "repo" {
190 back += "?tab=geheimen"
191 }
192 _ = s.Store.DeleteSecret(r.Context(), kind, scopeID, r.FormValue("name"))
193 s.redirect(w, r, back, "Geheim verwijderd", "")
194 }
195
196 func (s *Server) repoWebhook(w http.ResponseWriter, r *http.Request) { s.webhookPost(w, r, "repo") }
197 func (s *Server) repoWebhookDelete(w http.ResponseWriter, r *http.Request) {
198 s.webhookDelete(w, r, "repo")
199 }
200 func (s *Server) groupWebhook(w http.ResponseWriter, r *http.Request) {
201 s.webhookPost(w, r, "group")
202 }
203 func (s *Server) groupWebhookDelete(w http.ResponseWriter, r *http.Request) {
204 s.webhookDelete(w, r, "group")
205 }
206
207 func (s *Server) webhookPost(w http.ResponseWriter, r *http.Request, kind string) {
208 scopeID, back, ok := s.adminScope(w, r, kind)
209 if !ok || !s.csrfOK(w, r) {
210 return
211 }
212 if kind == "repo" {
213 back = strings.Split(back, "?")[0] + "?tab=webhooks"
214 }
215 preset := r.FormValue("preset")
216 if preset != webhook.PresetDiscord && preset != webhook.PresetGrok && preset != webhook.PresetGeneric {
217 s.redirect(w, r, back, "", "onbekende preset")
218 return
219 }
220 filter := strings.TrimSpace(r.FormValue("branch_filter"))
221 if _, err := webhook.MatchBranch(filter, "main"); err != nil {
222 s.redirect(w, r, back, "", err.Error())
223 return
224 }
225 var events []string
226 for _, e := range webhook.AllEvents() {
227 if r.FormValue("event_"+e) == "1" {
228 events = append(events, e)
229 }
230 }
231 if len(events) == 0 {
232 s.redirect(w, r, back, "", "kies minstens één gebeurtenis")
233 return
234 }
235 headers := map[string]string{}
236 for _, line := range strings.Split(r.FormValue("headers"), "\n") {
237 line = strings.TrimSpace(line)
238 if line == "" {
239 continue
240 }
241 k, v, ok := strings.Cut(line, ":")
242 if !ok || strings.TrimSpace(k) == "" {
243 s.redirect(w, r, back, "", "header moet 'Naam: waarde' zijn")
244 return
245 }
246 headers[strings.TrimSpace(k)] = strings.TrimSpace(v)
247 }
248 _, err := s.Store.CreateWebhook(r.Context(), store.Webhook{
249 ScopeKind: kind, ScopeID: scopeID, Name: strings.TrimSpace(r.FormValue("name")),
250 Preset: preset, URLTemplate: strings.TrimSpace(r.FormValue("url")),
251 Headers: headers, BodyTemplate: r.FormValue("body"), Events: events, BranchFilter: filter,
252 })
253 if err != nil {
254 s.redirect(w, r, back, "", err.Error())
255 return
256 }
257 s.redirect(w, r, back, "Webhook opgeslagen", "")
258 }
259
260 func (s *Server) webhookDelete(w http.ResponseWriter, r *http.Request, kind string) {
261 scopeID, back, ok := s.adminScope(w, r, kind)
262 if !ok || !s.csrfOK(w, r) {
263 return
264 }
265 if kind == "repo" {
266 back = strings.Split(back, "?")[0] + "?tab=webhooks"
267 }
268 id, _ := strconv.ParseInt(r.FormValue("id"), 10, 64)
269 _ = s.Store.DeleteWebhook(r.Context(), kind, scopeID, id)
270 s.redirect(w, r, back, "Webhook verwijderd", "")
271 }
272
273 func (s *Server) deleteRepo(w http.ResponseWriter, r *http.Request) {
274 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
275 if !ok || !s.csrfOK(w, r) {
276 return
277 }
278 if r.FormValue("confirm") != repo.Name {
279 s.redirect(w, r, repoURL(repo)+"/-/settings", "", "typ de repositorynaam om te verwijderen")
280 return
281 }
282 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
283 _ = s.Store.DeleteRepo(r.Context(), repo.ID)
284 _ = os.RemoveAll(dir)
285 s.redirect(w, r, "/", "Repository verwijderd", "")
286 }
287
288 func (s *Server) guardGroup(w http.ResponseWriter, r *http.Request, min access.Role) (store.Group, access.Role, bool) {
289 g, err := s.Store.GroupByPath(r.Context(), r.PathValue("path"))
290 if err != nil {
291 http.NotFound(w, r)
292 return store.Group{}, "", false
293 }
294 p := s.who(r)
295 if !p.OK {
296 http.Redirect(w, r, "/login", http.StatusFound)
297 return store.Group{}, "", false
298 }
299 role, err := s.Store.GroupRole(r.Context(), g.ID, p.User.ID)
300 if err != nil {
301 http.Error(w, "rechten", http.StatusInternalServerError)
302 return store.Group{}, "", false
303 }
304 if !role.AtLeast(min) && min != access.RoleReadonly {
305 http.Error(w, "geen toegang", http.StatusForbidden)
306 return store.Group{}, "", false
307 }
308 if min == access.RoleReadonly && !role.CanRead() {
309 http.Error(w, "geen toegang", http.StatusForbidden)
310 return store.Group{}, "", false
311 }
312 return g, role, true
313 }
314
315 func (s *Server) groupPage(w http.ResponseWriter, r *http.Request) {
316 g, role, ok := s.guardGroup(w, r, access.RoleReadonly)
317 if !ok {
318 return
319 }
320 v := s.view(w, r, g.Name)
321 v.Group = &g
322 v.Role = role
323 v.CanAdmin = role.CanManageSettings()
324 v.Repos, _ = s.Store.ReposByGroup(r.Context(), g.ID)
325 if role.CanManageSettings() {
326 v.Members, _ = s.Store.ListMembers(r.Context(), "group", g.ID)
327 v.Secrets, _ = s.Store.ListSecrets(r.Context(), "group", g.ID)
328 v.Hooks = s.hookViews(r, "group", g.ID)
329 }
330 s.render(w, "group", v)
331 }
@@ -0,0 +1,331 @@
1package server
2
3import (
4 "net/http"
5 "os"
6 "strconv"
7 "strings"
8
9 "gitlab.com/Timfa/bluegit/internal/access"
10 "gitlab.com/Timfa/bluegit/internal/gitrepo"
11 "gitlab.com/Timfa/bluegit/internal/store"
12 "gitlab.com/Timfa/bluegit/internal/webhook"
13)
14
15func (s *Server) settings(w http.ResponseWriter, r *http.Request) {
16 _, repo, role, ok := s.guard(w, r, access.RoleReadonly)
17 if !ok {
18 return
19 }
20 v := s.repoView(w, r, repo, role, "Instellingen")
21 v.Tab = r.URL.Query().Get("tab")
22 if v.Tab == "" {
23 v.Tab = "algemeen"
24 }
25 if role.CanManageSettings() {
26 v.Members, _ = s.Store.ListMembers(r.Context(), "repo", repo.ID)
27 if repo.OwnerKind == "user" {
28 owner, err := s.Store.UserByID(r.Context(), repo.OwnerID)
29 if err == nil {
30 v.Members = append([]store.Member{{UserID: owner.ID, Username: owner.Username, Role: access.RoleMaintainer}}, v.Members...)
31 }
32 }
33 v.Secrets, _ = s.Store.ListSecrets(r.Context(), "repo", repo.ID)
34 v.Patterns, _ = s.Store.ProtectedPatterns(r.Context(), repo.ID)
35 v.Hooks = s.hookViews(r, "repo", repo.ID)
36 }
37 s.render(w, "settings", v)
38}
39
40func (s *Server) hookViews(r *http.Request, kind string, id int64) []HookView {
41 hooks, err := s.Store.ListWebhooks(r.Context(), kind, id)
42 if err != nil {
43 return nil
44 }
45 var out []HookView
46 for _, h := range hooks {
47 d, _ := s.Store.RecentDeliveries(r.Context(), h.ID)
48 out = append(out, HookView{
49 ID: h.ID, Name: h.Name, Preset: h.Preset, URL: h.URLTemplate,
50 Filter: h.BranchFilter, Events: strings.Join(h.Events, ", "), Deliveries: d,
51 })
52 }
53 return out
54}
55
56func (s *Server) updateRepo(w http.ResponseWriter, r *http.Request) {
57 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
58 if !ok || !s.csrfOK(w, r) {
59 return
60 }
61 vis := r.FormValue("visibility")
62 if vis != "public" {
63 vis = "private"
64 }
65 if err := s.Store.UpdateRepo(r.Context(), repo.ID, r.FormValue("description"), vis); err != nil {
66 s.redirect(w, r, repoURL(repo)+"/-/settings", "", err.Error())
67 return
68 }
69 s.redirect(w, r, repoURL(repo)+"/-/settings", "Opgeslagen", "")
70}
71
72func (s *Server) repoMember(w http.ResponseWriter, r *http.Request) {
73 s.memberPost(w, r, "repo")
74}
75
76func (s *Server) repoMemberRemove(w http.ResponseWriter, r *http.Request) {
77 s.memberRemove(w, r, "repo")
78}
79
80func (s *Server) groupMember(w http.ResponseWriter, r *http.Request) {
81 s.memberPost(w, r, "group")
82}
83
84func (s *Server) groupMemberRemove(w http.ResponseWriter, r *http.Request) {
85 s.memberRemove(w, r, "group")
86}
87
88func (s *Server) memberPost(w http.ResponseWriter, r *http.Request, kind string) {
89 scopeID, back, ok := s.adminScope(w, r, kind)
90 if !ok || !s.csrfOK(w, r) {
91 return
92 }
93 role, err := access.ParseRole(r.FormValue("role"))
94 if err != nil {
95 s.redirect(w, r, back, "", err.Error())
96 return
97 }
98 if err := s.Store.SetMember(r.Context(), kind, scopeID, r.FormValue("username"), role); err != nil {
99 s.redirect(w, r, back, "", err.Error())
100 return
101 }
102 s.redirect(w, r, back, "Lid opgeslagen", "")
103}
104
105func (s *Server) memberRemove(w http.ResponseWriter, r *http.Request, kind string) {
106 scopeID, back, ok := s.adminScope(w, r, kind)
107 if !ok || !s.csrfOK(w, r) {
108 return
109 }
110 if err := s.Store.RemoveMember(r.Context(), kind, scopeID, r.FormValue("username")); err != nil {
111 s.redirect(w, r, back, "", err.Error())
112 return
113 }
114 s.redirect(w, r, back, "Lid verwijderd", "")
115}
116
117func (s *Server) adminScope(w http.ResponseWriter, r *http.Request, kind string) (int64, string, bool) {
118 if kind == "group" {
119 g, role, ok := s.guardGroup(w, r, access.RoleMaintainer)
120 if !ok {
121 return 0, "", false
122 }
123 _ = role
124 return g.ID, "/groups/" + g.Path, true
125 }
126 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
127 if !ok {
128 return 0, "", false
129 }
130 return repo.ID, repoURL(repo) + "/-/settings?tab=leden", true
131}
132
133func (s *Server) addProtected(w http.ResponseWriter, r *http.Request) {
134 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
135 if !ok || !s.csrfOK(w, r) {
136 return
137 }
138 if err := s.Store.AddProtected(r.Context(), repo.ID, r.FormValue("pattern")); err != nil {
139 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "", err.Error())
140 return
141 }
142 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "Branch beschermd", "")
143}
144
145func (s *Server) removeProtected(w http.ResponseWriter, r *http.Request) {
146 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
147 if !ok || !s.csrfOK(w, r) {
148 return
149 }
150 _ = s.Store.RemoveProtected(r.Context(), repo.ID, r.FormValue("pattern"))
151 s.redirect(w, r, repoURL(repo)+"/-/settings?tab=branches", "Patroon verwijderd", "")
152}
153
154func (s *Server) repoSecret(w http.ResponseWriter, r *http.Request) {
155 s.secretPost(w, r, "repo")
156}
157func (s *Server) repoSecretDelete(w http.ResponseWriter, r *http.Request) {
158 s.secretDelete(w, r, "repo")
159}
160func (s *Server) groupSecret(w http.ResponseWriter, r *http.Request) {
161 s.secretPost(w, r, "group")
162}
163func (s *Server) groupSecretDelete(w http.ResponseWriter, r *http.Request) {
164 s.secretDelete(w, r, "group")
165}
166
167func (s *Server) secretPost(w http.ResponseWriter, r *http.Request, kind string) {
168 scopeID, back, ok := s.adminScope(w, r, kind)
169 if !ok || !s.csrfOK(w, r) {
170 return
171 }
172 back = strings.Split(back, "?")[0]
173 if kind == "repo" {
174 back += "?tab=geheimen"
175 }
176 if err := s.Store.PutSecret(r.Context(), kind, scopeID, strings.TrimSpace(r.FormValue("name")), r.FormValue("value"), r.FormValue("protected") == "1"); err != nil {
177 s.redirect(w, r, back, "", err.Error())
178 return
179 }
180 s.redirect(w, r, back, "Geheim opgeslagen", "")
181}
182
183func (s *Server) secretDelete(w http.ResponseWriter, r *http.Request, kind string) {
184 scopeID, back, ok := s.adminScope(w, r, kind)
185 if !ok || !s.csrfOK(w, r) {
186 return
187 }
188 back = strings.Split(back, "?")[0]
189 if kind == "repo" {
190 back += "?tab=geheimen"
191 }
192 _ = s.Store.DeleteSecret(r.Context(), kind, scopeID, r.FormValue("name"))
193 s.redirect(w, r, back, "Geheim verwijderd", "")
194}
195
196func (s *Server) repoWebhook(w http.ResponseWriter, r *http.Request) { s.webhookPost(w, r, "repo") }
197func (s *Server) repoWebhookDelete(w http.ResponseWriter, r *http.Request) {
198 s.webhookDelete(w, r, "repo")
199}
200func (s *Server) groupWebhook(w http.ResponseWriter, r *http.Request) {
201 s.webhookPost(w, r, "group")
202}
203func (s *Server) groupWebhookDelete(w http.ResponseWriter, r *http.Request) {
204 s.webhookDelete(w, r, "group")
205}
206
207func (s *Server) webhookPost(w http.ResponseWriter, r *http.Request, kind string) {
208 scopeID, back, ok := s.adminScope(w, r, kind)
209 if !ok || !s.csrfOK(w, r) {
210 return
211 }
212 if kind == "repo" {
213 back = strings.Split(back, "?")[0] + "?tab=webhooks"
214 }
215 preset := r.FormValue("preset")
216 if preset != webhook.PresetDiscord && preset != webhook.PresetGrok && preset != webhook.PresetGeneric {
217 s.redirect(w, r, back, "", "onbekende preset")
218 return
219 }
220 filter := strings.TrimSpace(r.FormValue("branch_filter"))
221 if _, err := webhook.MatchBranch(filter, "main"); err != nil {
222 s.redirect(w, r, back, "", err.Error())
223 return
224 }
225 var events []string
226 for _, e := range webhook.AllEvents() {
227 if r.FormValue("event_"+e) == "1" {
228 events = append(events, e)
229 }
230 }
231 if len(events) == 0 {
232 s.redirect(w, r, back, "", "kies minstens één gebeurtenis")
233 return
234 }
235 headers := map[string]string{}
236 for _, line := range strings.Split(r.FormValue("headers"), "\n") {
237 line = strings.TrimSpace(line)
238 if line == "" {
239 continue
240 }
241 k, v, ok := strings.Cut(line, ":")
242 if !ok || strings.TrimSpace(k) == "" {
243 s.redirect(w, r, back, "", "header moet 'Naam: waarde' zijn")
244 return
245 }
246 headers[strings.TrimSpace(k)] = strings.TrimSpace(v)
247 }
248 _, err := s.Store.CreateWebhook(r.Context(), store.Webhook{
249 ScopeKind: kind, ScopeID: scopeID, Name: strings.TrimSpace(r.FormValue("name")),
250 Preset: preset, URLTemplate: strings.TrimSpace(r.FormValue("url")),
251 Headers: headers, BodyTemplate: r.FormValue("body"), Events: events, BranchFilter: filter,
252 })
253 if err != nil {
254 s.redirect(w, r, back, "", err.Error())
255 return
256 }
257 s.redirect(w, r, back, "Webhook opgeslagen", "")
258}
259
260func (s *Server) webhookDelete(w http.ResponseWriter, r *http.Request, kind string) {
261 scopeID, back, ok := s.adminScope(w, r, kind)
262 if !ok || !s.csrfOK(w, r) {
263 return
264 }
265 if kind == "repo" {
266 back = strings.Split(back, "?")[0] + "?tab=webhooks"
267 }
268 id, _ := strconv.ParseInt(r.FormValue("id"), 10, 64)
269 _ = s.Store.DeleteWebhook(r.Context(), kind, scopeID, id)
270 s.redirect(w, r, back, "Webhook verwijderd", "")
271}
272
273func (s *Server) deleteRepo(w http.ResponseWriter, r *http.Request) {
274 _, repo, _, ok := s.guard(w, r, access.RoleMaintainer)
275 if !ok || !s.csrfOK(w, r) {
276 return
277 }
278 if r.FormValue("confirm") != repo.Name {
279 s.redirect(w, r, repoURL(repo)+"/-/settings", "", "typ de repositorynaam om te verwijderen")
280 return
281 }
282 dir := gitrepo.Dir(s.StoragePath(), repo.OwnerPath, repo.Name)
283 _ = s.Store.DeleteRepo(r.Context(), repo.ID)
284 _ = os.RemoveAll(dir)
285 s.redirect(w, r, "/", "Repository verwijderd", "")
286}
287
288func (s *Server) guardGroup(w http.ResponseWriter, r *http.Request, min access.Role) (store.Group, access.Role, bool) {
289 g, err := s.Store.GroupByPath(r.Context(), r.PathValue("path"))
290 if err != nil {
291 http.NotFound(w, r)
292 return store.Group{}, "", false
293 }
294 p := s.who(r)
295 if !p.OK {
296 http.Redirect(w, r, "/login", http.StatusFound)
297 return store.Group{}, "", false
298 }
299 role, err := s.Store.GroupRole(r.Context(), g.ID, p.User.ID)
300 if err != nil {
301 http.Error(w, "rechten", http.StatusInternalServerError)
302 return store.Group{}, "", false
303 }
304 if !role.AtLeast(min) && min != access.RoleReadonly {
305 http.Error(w, "geen toegang", http.StatusForbidden)
306 return store.Group{}, "", false
307 }
308 if min == access.RoleReadonly && !role.CanRead() {
309 http.Error(w, "geen toegang", http.StatusForbidden)
310 return store.Group{}, "", false
311 }
312 return g, role, true
313}
314
315func (s *Server) groupPage(w http.ResponseWriter, r *http.Request) {
316 g, role, ok := s.guardGroup(w, r, access.RoleReadonly)
317 if !ok {
318 return
319 }
320 v := s.view(w, r, g.Name)
321 v.Group = &g
322 v.Role = role
323 v.CanAdmin = role.CanManageSettings()
324 v.Repos, _ = s.Store.ReposByGroup(r.Context(), g.ID)
325 if role.CanManageSettings() {
326 v.Members, _ = s.Store.ListMembers(r.Context(), "group", g.ID)
327 v.Secrets, _ = s.Store.ListSecrets(r.Context(), "group", g.ID)
328 v.Hooks = s.hookViews(r, "group", g.ID)
329 }
330 s.render(w, "group", v)
331}
internal/server/setup.go added +182 −0
@@ -0,0 +1,182 @@
1 package server
2
3 import (
4 "context"
5 "net/http"
6 "os"
7 "strings"
8
9 "gitlab.com/Timfa/bluegit/internal/gitrepo"
10 "gitlab.com/Timfa/bluegit/internal/state"
11 )
12
13 const noStorageMsg = "Opslag is nog niet ingesteld. De beheerder kiest een pad in de webinterface.\n"
14
15 func allowsWithoutStorage(r *http.Request) bool {
16 switch r.URL.Path {
17 case "/healthz", "/login", "/auth/callback", "/logout", "/setup":
18 return true
19 }
20 return strings.HasPrefix(r.URL.Path, "/assets/")
21 }
22
23 func isGitPath(path string) bool {
24 return strings.HasSuffix(path, "/info/refs") ||
25 strings.HasSuffix(path, "/git-upload-pack") ||
26 strings.HasSuffix(path, "/git-receive-pack")
27 }
28
29 func (s *Server) gate(next http.Handler) http.Handler {
30 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
31 if allowsWithoutStorage(r) || s.StoragePath() != "" {
32 next.ServeHTTP(w, r)
33 return
34 }
35 if isGitPath(r.URL.Path) || strings.HasPrefix(r.URL.Path, "/api/") {
36 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
37 return
38 }
39 if p := s.who(r); p.OK && p.User.InstanceAdmin {
40 http.Redirect(w, r, "/setup", http.StatusFound)
41 return
42 }
43 next.ServeHTTP(w, r)
44 })
45 }
46
47 // StoragePath is de datadisk. Leeg zolang de beheerder er geen heeft gekozen.
48 func (s *Server) StoragePath() string {
49 s.storageMu.RLock()
50 set, path := s.storageSet, s.storage
51 s.storageMu.RUnlock()
52 if set {
53 return path
54 }
55 s.storageMu.Lock()
56 defer s.storageMu.Unlock()
57 if !s.storageSet {
58 s.storage = s.Cfg.StoragePath
59 s.storageSet = true
60 }
61 return s.storage
62 }
63
64 // AdoptStorage zet het pad dat bij het starten al geldig was.
65 func (s *Server) AdoptStorage(path string) {
66 s.storageMu.Lock()
67 s.storage = path
68 s.storageSet = true
69 s.storageMu.Unlock()
70 if path != "" && s.AfterStorage != nil {
71 s.AfterStorage(path)
72 }
73 }
74
75 func (s *Server) setupPage(w http.ResponseWriter, r *http.Request) {
76 if _, ok := s.adminOnly(w, r); !ok {
77 return
78 }
79 s.renderSetup(w, r, "", "")
80 }
81
82 func (s *Server) setupSave(w http.ResponseWriter, r *http.Request) {
83 if _, ok := s.adminOnly(w, r); !ok || !s.csrfOK(w, r) {
84 return
85 }
86 if s.StateDir == "" {
87 s.renderSetup(w, r, "Het pad kon niet bewaard worden.", r.FormValue("path"))
88 return
89 }
90 info, err := state.Inspect(r.FormValue("path"))
91 if err != nil {
92 s.renderSetup(w, r, err.Error(), strings.TrimSpace(r.FormValue("path")))
93 return
94 }
95 if same, err := samePath(s.StateDir, info.Path); err != nil {
96 s.renderSetup(w, r, err.Error(), info.Path)
97 return
98 } else if same {
99 s.renderSetup(w, r, "Kies de map voor de repositories.", info.Path)
100 return
101 }
102 previous := s.StoragePath()
103 if err := state.Write(s.StateDir, info.Path); err != nil {
104 s.renderSetup(w, r, err.Error(), info.Path)
105 return
106 }
107 s.AdoptStorage(info.Path)
108 s.RefreshHooks()
109 notice := "Opslag ingesteld op " + info.Path + ". " + state.Format(info.Free) + " vrij."
110 if previous != "" && previous != info.Path {
111 notice = "Opslagpad gewijzigd naar " + info.Path + ". Bestaande data is niet verplaatst. " + state.Format(info.Free) + " vrij."
112 }
113 s.redirect(w, r, "/", notice, "")
114 }
115
116 func samePath(stateDir, path string) (bool, error) {
117 if stateDir == "" {
118 return false, nil
119 }
120 return strings.TrimRight(stateDir, "/") == strings.TrimRight(path, "/"), nil
121 }
122
123 func (s *Server) adminOnly(w http.ResponseWriter, r *http.Request) (bool, bool) {
124 u, ok := s.loginRequired(w, r)
125 if !ok {
126 return false, false
127 }
128 if !u.InstanceAdmin {
129 http.Error(w, "Je mag de opslag niet instellen.", http.StatusForbidden)
130 return false, false
131 }
132 return true, true
133 }
134
135 func (s *Server) renderSetup(w http.ResponseWriter, r *http.Request, problem, prefill string) {
136 v := s.view(w, r, "Opslag")
137 if problem != "" {
138 v.Err = problem
139 }
140 v.MinFree = state.Format(state.MinFreeBytes)
141 v.StoragePath = strings.TrimSpace(prefill)
142 if v.StoragePath == "" {
143 v.StoragePath = s.StoragePath()
144 }
145 if v.StoragePath == "" && s.StateDir != "" {
146 if saved, err := state.Read(s.StateDir); err == nil {
147 v.StoragePath = saved
148 }
149 }
150 if v.StoragePath != "" {
151 info, err := state.Inspect(v.StoragePath)
152 if info.Total > 0 {
153 v.StorageFree = state.Format(info.Free)
154 v.StorageTotal = state.Format(info.Total)
155 }
156 if err != nil && v.Err == "" {
157 v.Err = err.Error()
158 }
159 }
160 s.render(w, "setup", v)
161 }
162
163 // RefreshHooks zet de pre-receive-hook opnieuw in elke repository die op de datadisk staat.
164 func (s *Server) RefreshHooks() {
165 root := s.StoragePath()
166 if root == "" || s.HookBin == "" || s.Store == nil {
167 return
168 }
169 repos, err := s.Store.AllRepos(context.Background())
170 if err != nil {
171 return
172 }
173 for _, repo := range repos {
174 dir := gitrepo.Dir(root, repo.OwnerPath, repo.Name)
175 if _, err := os.Stat(dir); err != nil {
176 continue
177 }
178 if err := gitrepo.InstallHook(dir, s.HookBin); err != nil && s.Log != nil {
179 s.Log.Error("hook", "repo", repo.FullPath(), "err", err)
180 }
181 }
182 }
@@ -0,0 +1,182 @@
1package server
2
3import (
4 "context"
5 "net/http"
6 "os"
7 "strings"
8
9 "gitlab.com/Timfa/bluegit/internal/gitrepo"
10 "gitlab.com/Timfa/bluegit/internal/state"
11)
12
13const noStorageMsg = "Opslag is nog niet ingesteld. De beheerder kiest een pad in de webinterface.\n"
14
15func allowsWithoutStorage(r *http.Request) bool {
16 switch r.URL.Path {
17 case "/healthz", "/login", "/auth/callback", "/logout", "/setup":
18 return true
19 }
20 return strings.HasPrefix(r.URL.Path, "/assets/")
21}
22
23func isGitPath(path string) bool {
24 return strings.HasSuffix(path, "/info/refs") ||
25 strings.HasSuffix(path, "/git-upload-pack") ||
26 strings.HasSuffix(path, "/git-receive-pack")
27}
28
29func (s *Server) gate(next http.Handler) http.Handler {
30 return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
31 if allowsWithoutStorage(r) || s.StoragePath() != "" {
32 next.ServeHTTP(w, r)
33 return
34 }
35 if isGitPath(r.URL.Path) || strings.HasPrefix(r.URL.Path, "/api/") {
36 http.Error(w, noStorageMsg, http.StatusServiceUnavailable)
37 return
38 }
39 if p := s.who(r); p.OK && p.User.InstanceAdmin {
40 http.Redirect(w, r, "/setup", http.StatusFound)
41 return
42 }
43 next.ServeHTTP(w, r)
44 })
45}
46
47// StoragePath is de datadisk. Leeg zolang de beheerder er geen heeft gekozen.
48func (s *Server) StoragePath() string {
49 s.storageMu.RLock()
50 set, path := s.storageSet, s.storage
51 s.storageMu.RUnlock()
52 if set {
53 return path
54 }
55 s.storageMu.Lock()
56 defer s.storageMu.Unlock()
57 if !s.storageSet {
58 s.storage = s.Cfg.StoragePath
59 s.storageSet = true
60 }
61 return s.storage
62}
63
64// AdoptStorage zet het pad dat bij het starten al geldig was.
65func (s *Server) AdoptStorage(path string) {
66 s.storageMu.Lock()
67 s.storage = path
68 s.storageSet = true
69 s.storageMu.Unlock()
70 if path != "" && s.AfterStorage != nil {
71 s.AfterStorage(path)
72 }
73}
74
75func (s *Server) setupPage(w http.ResponseWriter, r *http.Request) {
76 if _, ok := s.adminOnly(w, r); !ok {
77 return
78 }
79 s.renderSetup(w, r, "", "")
80}
81
82func (s *Server) setupSave(w http.ResponseWriter, r *http.Request) {
83 if _, ok := s.adminOnly(w, r); !ok || !s.csrfOK(w, r) {
84 return
85 }
86 if s.StateDir == "" {
87 s.renderSetup(w, r, "Het pad kon niet bewaard worden.", r.FormValue("path"))
88 return
89 }
90 info, err := state.Inspect(r.FormValue("path"))
91 if err != nil {
92 s.renderSetup(w, r, err.Error(), strings.TrimSpace(r.FormValue("path")))
93 return
94 }
95 if same, err := samePath(s.StateDir, info.Path); err != nil {
96 s.renderSetup(w, r, err.Error(), info.Path)
97 return
98 } else if same {
99 s.renderSetup(w, r, "Kies de map voor de repositories.", info.Path)
100 return
101 }
102 previous := s.StoragePath()
103 if err := state.Write(s.StateDir, info.Path); err != nil {
104 s.renderSetup(w, r, err.Error(), info.Path)
105 return
106 }
107 s.AdoptStorage(info.Path)
108 s.RefreshHooks()
109 notice := "Opslag ingesteld op " + info.Path + ". " + state.Format(info.Free) + " vrij."
110 if previous != "" && previous != info.Path {
111 notice = "Opslagpad gewijzigd naar " + info.Path + ". Bestaande data is niet verplaatst. " + state.Format(info.Free) + " vrij."
112 }
113 s.redirect(w, r, "/", notice, "")
114}
115
116func samePath(stateDir, path string) (bool, error) {
117 if stateDir == "" {
118 return false, nil
119 }
120 return strings.TrimRight(stateDir, "/") == strings.TrimRight(path, "/"), nil
121}
122
123func (s *Server) adminOnly(w http.ResponseWriter, r *http.Request) (bool, bool) {
124 u, ok := s.loginRequired(w, r)
125 if !ok {
126 return false, false
127 }
128 if !u.InstanceAdmin {
129 http.Error(w, "Je mag de opslag niet instellen.", http.StatusForbidden)
130 return false, false
131 }
132 return true, true
133}
134
135func (s *Server) renderSetup(w http.ResponseWriter, r *http.Request, problem, prefill string) {
136 v := s.view(w, r, "Opslag")
137 if problem != "" {
138 v.Err = problem
139 }
140 v.MinFree = state.Format(state.MinFreeBytes)
141 v.StoragePath = strings.TrimSpace(prefill)
142 if v.StoragePath == "" {
143 v.StoragePath = s.StoragePath()
144 }
145 if v.StoragePath == "" && s.StateDir != "" {
146 if saved, err := state.Read(s.StateDir); err == nil {
147 v.StoragePath = saved
148 }
149 }
150 if v.StoragePath != "" {
151 info, err := state.Inspect(v.StoragePath)
152 if info.Total > 0 {
153 v.StorageFree = state.Format(info.Free)
154 v.StorageTotal = state.Format(info.Total)
155 }
156 if err != nil && v.Err == "" {
157 v.Err = err.Error()
158 }
159 }
160 s.render(w, "setup", v)
161}
162
163// RefreshHooks zet de pre-receive-hook opnieuw in elke repository die op de datadisk staat.
164func (s *Server) RefreshHooks() {
165 root := s.StoragePath()
166 if root == "" || s.HookBin == "" || s.Store == nil {
167 return
168 }
169 repos, err := s.Store.AllRepos(context.Background())
170 if err != nil {
171 return
172 }
173 for _, repo := range repos {
174 dir := gitrepo.Dir(root, repo.OwnerPath, repo.Name)
175 if _, err := os.Stat(dir); err != nil {
176 continue
177 }
178 if err := gitrepo.InstallHook(dir, s.HookBin); err != nil && s.Log != nil {
179 s.Log.Error("hook", "repo", repo.FullPath(), "err", err)
180 }
181 }
182}
internal/server/static/logo.svg added +55 −0
@@ -0,0 +1,55 @@
1 <?xml version="1.0" encoding="UTF-8" standalone="no"?>
2 <svg
3 width="24"
4 height="24"
5 viewBox="0 0 24 24"
6 version="1.1"
7 id="svg1"
8 sodipodi:docname="iconmonstr-star-3.svg"
9 xml:space="preserve"
10 inkscape:version="1.4.4 (dcaf3e7, 2026-05-05)"
11 xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
12 xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
13 xmlns:xlink="http://www.w3.org/1999/xlink"
14 xmlns="http://www.w3.org/2000/svg"
15 xmlns:svg="http://www.w3.org/2000/svg"><defs
16 id="defs1"><linearGradient
17 id="linearGradient1"
18 inkscape:collect="always"><stop
19 style="stop-color:#6c6dff;stop-opacity:1;"
20 offset="0"
21 id="stop1" /><stop
22 style="stop-color:#0029e7;stop-opacity:1;"
23 offset="1"
24 id="stop2" /></linearGradient><radialGradient
25 inkscape:collect="always"
26 xlink:href="#linearGradient1"
27 id="radialGradient2"
28 cx="12"
29 cy="12"
30 fx="12"
31 fy="12"
32 r="12"
33 gradientTransform="matrix(1,0,0,0.95108333,0,0.587)"
34 gradientUnits="userSpaceOnUse" /></defs><sodipodi:namedview
35 id="namedview1"
36 pagecolor="#505050"
37 bordercolor="#ffffff"
38 borderopacity="1"
39 inkscape:showpageshadow="0"
40 inkscape:pageopacity="0"
41 inkscape:pagecheckerboard="1"
42 inkscape:deskcolor="#505050"
43 showguides="false"
44 inkscape:zoom="16.854167"
45 inkscape:cx="18.719407"
46 inkscape:cy="14.150803"
47 inkscape:window-width="1920"
48 inkscape:window-height="1020"
49 inkscape:window-x="0"
50 inkscape:window-y="0"
51 inkscape:window-maximized="1"
52 inkscape:current-layer="svg1" /><path
53 id="path1"
54 style="fill:url(#radialGradient2);stroke:#fdfdfd;stroke-opacity:1;stroke-width:0.198;stroke-dasharray:none;stroke-linejoin:round"
55 d="M 12 0.58789062 L 8.7929688 7.203125 L 10.71875 9.1289062 C 11.171725 8.9758246 11.691792 9.0783281 12.052734 9.4394531 C 12.415889 9.8027921 12.51633 10.326615 12.359375 10.78125 L 14.238281 12.660156 C 14.692916 12.503385 15.217108 12.605227 15.580078 12.96875 C 16.087277 13.475949 16.087277 14.29712 15.580078 14.804688 C 15.07251 15.312071 14.251894 15.312071 13.744141 14.804688 C 13.362726 14.422904 13.267465 13.862521 13.460938 13.392578 L 11.708984 11.640625 L 11.708984 16.251953 C 11.832556 16.313183 11.949818 16.393179 12.052734 16.496094 C 12.559933 17.003294 12.559933 17.826232 12.052734 18.333984 C 11.545534 18.841 10.721675 18.841 10.214844 18.333984 C 9.7076436 17.826047 9.7076436 17.00311 10.214844 16.496094 C 10.34026 16.370863 10.485699 16.276337 10.640625 16.212891 L 10.640625 11.560547 C 10.485699 11.4971 10.34063 11.403499 10.214844 11.277344 C 9.8306627 10.893348 9.7385689 10.329209 9.9355469 9.8574219 L 8.2460938 8.1660156 L 0 9.3066406 L 6.0644531 15.134766 L 4.5820312 23.412109 L 12 19.445312 L 19.416016 23.412109 L 17.935547 15.134766 L 24 9.3066406 L 15.667969 8.1542969 L 12 0.58789062 z " /></svg>
@@ -0,0 +1,55 @@
1<?xml version="1.0" encoding="UTF-8" standalone="no"?>
2<svg
3 width="24"
4 height="24"
5 viewBox="0 0 24 24"
6 version="1.1"
7 id="svg1"
8 sodipodi:docname="iconmonstr-star-3.svg"
9 xml:space="preserve"
10 inkscape:version="1.4.4 (dcaf3e7, 2026-05-05)"
11 xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape"
12 xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd"
13 xmlns:xlink="http://www.w3.org/1999/xlink"
14 xmlns="http://www.w3.org/2000/svg"
15 xmlns:svg="http://www.w3.org/2000/svg"><defs
16 id="defs1"><linearGradient
17 id="linearGradient1"
18 inkscape:collect="always"><stop
19 style="stop-color:#6c6dff;stop-opacity:1;"
20 offset="0"
21 id="stop1" /><stop
22 style="stop-color:#0029e7;stop-opacity:1;"
23 offset="1"
24 id="stop2" /></linearGradient><radialGradient
25 inkscape:collect="always"
26 xlink:href="#linearGradient1"
27 id="radialGradient2"
28 cx="12"
29 cy="12"
30 fx="12"
31 fy="12"
32 r="12"
33 gradientTransform="matrix(1,0,0,0.95108333,0,0.587)"
34 gradientUnits="userSpaceOnUse" /></defs><sodipodi:namedview
35 id="namedview1"
36 pagecolor="#505050"
37 bordercolor="#ffffff"
38 borderopacity="1"
39 inkscape:showpageshadow="0"
40 inkscape:pageopacity="0"
41 inkscape:pagecheckerboard="1"
42 inkscape:deskcolor="#505050"
43 showguides="false"
44 inkscape:zoom="16.854167"
45 inkscape:cx="18.719407"
46 inkscape:cy="14.150803"
47 inkscape:window-width="1920"
48 inkscape:window-height="1020"
49 inkscape:window-x="0"
50 inkscape:window-y="0"
51 inkscape:window-maximized="1"
52 inkscape:current-layer="svg1" /><path
53 id="path1"
54 style="fill:url(#radialGradient2);stroke:#fdfdfd;stroke-opacity:1;stroke-width:0.198;stroke-dasharray:none;stroke-linejoin:round"
55 d="M 12 0.58789062 L 8.7929688 7.203125 L 10.71875 9.1289062 C 11.171725 8.9758246 11.691792 9.0783281 12.052734 9.4394531 C 12.415889 9.8027921 12.51633 10.326615 12.359375 10.78125 L 14.238281 12.660156 C 14.692916 12.503385 15.217108 12.605227 15.580078 12.96875 C 16.087277 13.475949 16.087277 14.29712 15.580078 14.804688 C 15.07251 15.312071 14.251894 15.312071 13.744141 14.804688 C 13.362726 14.422904 13.267465 13.862521 13.460938 13.392578 L 11.708984 11.640625 L 11.708984 16.251953 C 11.832556 16.313183 11.949818 16.393179 12.052734 16.496094 C 12.559933 17.003294 12.559933 17.826232 12.052734 18.333984 C 11.545534 18.841 10.721675 18.841 10.214844 18.333984 C 9.7076436 17.826047 9.7076436 17.00311 10.214844 16.496094 C 10.34026 16.370863 10.485699 16.276337 10.640625 16.212891 L 10.640625 11.560547 C 10.485699 11.4971 10.34063 11.403499 10.214844 11.277344 C 9.8306627 10.893348 9.7385689 10.329209 9.9355469 9.8574219 L 8.2460938 8.1660156 L 0 9.3066406 L 6.0644531 15.134766 L 4.5820312 23.412109 L 12 19.445312 L 19.416016 23.412109 L 17.935547 15.134766 L 24 9.3066406 L 15.667969 8.1542969 L 12 0.58789062 z " /></svg>
internal/server/static/style.css added +65 −0
@@ -0,0 +1,65 @@
1 :root {
2 --ink: #142033;
3 --blue: #1f6feb;
4 --blue-deep: #0c3f86;
5 --paper: #f3f6fb;
6 --card: #ffffff;
7 --line: #d5e0ee;
8 --muted: #5c6b80;
9 --bad: #9f2d2d;
10 --ok: #146c43;
11 --shadow: 0 10px 30px rgba(20, 32, 51, 0.06);
12 font-family: "Segoe UI", "Avenir Next", "Trebuchet MS", sans-serif;
13 }
14 * { box-sizing: border-box; }
15 body { margin: 0; background: var(--paper); color: var(--ink); }
16 a { color: var(--blue-deep); }
17 .top {
18 display: flex; justify-content: space-between; align-items: center;
19 padding: 0.8rem 1.4rem; background: var(--ink); color: white;
20 }
21 .top a { color: white; text-decoration: none; }
22 .brand { display: flex; gap: 0.6rem; align-items: center; font-weight: 700; letter-spacing: 0.02em; }
23 .brand img { width: 32px; height: 32px; }
24 .top nav { display: flex; gap: 1rem; align-items: center; }
25 .top button, .btn, button {
26 background: var(--blue); color: white; border: 0; border-radius: 999px;
27 padding: 0.45rem 0.9rem; cursor: pointer; font: inherit;
28 }
29 .btn.ghost, button.ghost { background: transparent; color: var(--ink); border: 1px solid var(--line); }
30 .top button { background: transparent; border: 1px solid rgba(255,255,255,.35); }
31 main { max-width: 980px; margin: 0 auto; padding: 1.4rem; }
32 .hero { display: grid; grid-template-columns: 120px 1fr; gap: 1.2rem; align-items: center; }
33 .hero img { width: 120px; }
34 .card, .panel {
35 background: var(--card); border: 1px solid var(--line); border-radius: 16px;
36 padding: 1rem 1.1rem; box-shadow: var(--shadow); margin: 0.8rem 0;
37 }
38 .flash { padding: 0.7rem 0.9rem; border-radius: 12px; background: #e5f6ec; color: var(--ok); }
39 .flash.bad { background: #fde8e8; color: var(--bad); }
40 .tabs, .sub { display: flex; gap: 0.8rem; flex-wrap: wrap; margin: 0.4rem 0 1rem; }
41 .sub a { text-decoration: none; padding-bottom: 0.2rem; }
42 .muted { color: var(--muted); }
43 label { display: block; margin: 0.55rem 0; }
44 input[type="checkbox"] { width: auto; }
45 input, textarea, select {
46 width: 100%; padding: 0.5rem 0.6rem; border: 1px solid var(--line); border-radius: 10px;
47 font: inherit; background: white;
48 }
49 textarea { min-height: 7rem; }
50 .row { display: flex; gap: 0.6rem; align-items: center; }
51 .row input, .row select { width: auto; flex: 1; }
52 code, pre { font-family: "IBM Plex Mono", "ui-monospace", monospace; }
53 pre, .code {
54 background: #0f1b2d; color: #e7eef8; padding: 0.8rem 1rem; border-radius: 12px; overflow: auto;
55 }
56 ul.clean { list-style: none; padding: 0; }
57 ul.clean li { padding: 0.45rem 0; border-bottom: 1px solid var(--line); }
58 .pill { font-size: 0.78rem; border: 1px solid var(--line); border-radius: 999px; padding: 0.1rem 0.45rem; }
59 table { width: 100%; border-collapse: collapse; }
60 td, th { text-align: left; padding: 0.4rem 0.3rem; border-bottom: 1px solid var(--line); vertical-align: top; }
61 .grid-2 { display: grid; grid-template-columns: 1fr 1fr; gap: 1rem; }
62 @media (max-width: 720px) {
63 .hero, .grid-2 { grid-template-columns: 1fr; }
64 main { padding: 0.8rem; }
65 }
@@ -0,0 +1,65 @@
1:root {
2 --ink: #142033;
3 --blue: #1f6feb;
4 --blue-deep: #0c3f86;
5 --paper: #f3f6fb;
6 --card: #ffffff;
7 --line: #d5e0ee;
8 --muted: #5c6b80;
9 --bad: #9f2d2d;
10 --ok: #146c43;
11 --shadow: 0 10px 30px rgba(20, 32, 51, 0.06);
12 font-family: "Segoe UI", "Avenir Next", "Trebuchet MS", sans-serif;
13}
14* { box-sizing: border-box; }
15body { margin: 0; background: var(--paper); color: var(--ink); }
16a { color: var(--blue-deep); }
17.top {
18 display: flex; justify-content: space-between; align-items: center;
19 padding: 0.8rem 1.4rem; background: var(--ink); color: white;
20}
21.top a { color: white; text-decoration: none; }
22.brand { display: flex; gap: 0.6rem; align-items: center; font-weight: 700; letter-spacing: 0.02em; }
23.brand img { width: 32px; height: 32px; }
24.top nav { display: flex; gap: 1rem; align-items: center; }
25.top button, .btn, button {
26 background: var(--blue); color: white; border: 0; border-radius: 999px;
27 padding: 0.45rem 0.9rem; cursor: pointer; font: inherit;
28}
29.btn.ghost, button.ghost { background: transparent; color: var(--ink); border: 1px solid var(--line); }
30.top button { background: transparent; border: 1px solid rgba(255,255,255,.35); }
31main { max-width: 980px; margin: 0 auto; padding: 1.4rem; }
32.hero { display: grid; grid-template-columns: 120px 1fr; gap: 1.2rem; align-items: center; }
33.hero img { width: 120px; }
34.card, .panel {
35 background: var(--card); border: 1px solid var(--line); border-radius: 16px;
36 padding: 1rem 1.1rem; box-shadow: var(--shadow); margin: 0.8rem 0;
37}
38.flash { padding: 0.7rem 0.9rem; border-radius: 12px; background: #e5f6ec; color: var(--ok); }
39.flash.bad { background: #fde8e8; color: var(--bad); }
40.tabs, .sub { display: flex; gap: 0.8rem; flex-wrap: wrap; margin: 0.4rem 0 1rem; }
41.sub a { text-decoration: none; padding-bottom: 0.2rem; }
42.muted { color: var(--muted); }
43label { display: block; margin: 0.55rem 0; }
44input[type="checkbox"] { width: auto; }
45input, textarea, select {
46 width: 100%; padding: 0.5rem 0.6rem; border: 1px solid var(--line); border-radius: 10px;
47 font: inherit; background: white;
48}
49textarea { min-height: 7rem; }
50.row { display: flex; gap: 0.6rem; align-items: center; }
51.row input, .row select { width: auto; flex: 1; }
52code, pre { font-family: "IBM Plex Mono", "ui-monospace", monospace; }
53pre, .code {
54 background: #0f1b2d; color: #e7eef8; padding: 0.8rem 1rem; border-radius: 12px; overflow: auto;
55}
56ul.clean { list-style: none; padding: 0; }
57ul.clean li { padding: 0.45rem 0; border-bottom: 1px solid var(--line); }
58.pill { font-size: 0.78rem; border: 1px solid var(--line); border-radius: 999px; padding: 0.1rem 0.45rem; }
59table { width: 100%; border-collapse: collapse; }
60td, th { text-align: left; padding: 0.4rem 0.3rem; border-bottom: 1px solid var(--line); vertical-align: top; }
61.grid-2 { display: grid; grid-template-columns: 1fr 1fr; gap: 1rem; }
62@media (max-width: 720px) {
63 .hero, .grid-2 { grid-template-columns: 1fr; }
64 main { padding: 0.8rem; }
65}
internal/server/templates/collab.html added +227 −0
@@ -0,0 +1,227 @@
1 {{define "mrs"}}
2 {{template "layout-start" .}}
3 <h1>Merge requests</h1>
4 {{template "repotabs" .}}
5 <ul class="clean">
6 {{range .MRs}}<li><a href="/{{$.Repo.FullPath}}/-/merge-requests/{{.Number}}">!{{.Number}} {{.Title}}</a> <span class="pill">{{.Status}}</span> <span class="muted">{{.SourceBranch}} → {{.TargetBranch}}</span></li>{{else}}<li class="muted">Geen merge requests.</li>{{end}}
7 </ul>
8 {{if .CanWrite}}
9 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/merge-requests">
10 <h2>Nieuw</h2>
11 <input type="hidden" name="csrf" value="{{.CSRF}}">
12 <label>Titel <input name="title" required></label>
13 <label>Beschrijving <textarea name="description"></textarea></label>
14 <label>Bron <select name="source">{{range .Branches}}<option>{{.Name}}</option>{{end}}</select></label>
15 <label>Doel <select name="target">{{range .Branches}}<option>{{.Name}}</option>{{end}}</select></label>
16 <button type="submit">Openen</button>
17 </form>
18 {{end}}
19 {{template "layout-end" .}}
20 {{end}}
21
22 {{define "mr"}}
23 {{template "layout-start" .}}
24 <h1>!{{.MR.Number}} {{.MR.Title}}</h1>
25 {{template "repotabs" .}}
26 <p><span class="pill">{{.MR.Status}}</span> {{.MR.SourceBranch}} → {{.MR.TargetBranch}} · {{.MR.Author}}</p>
27 {{if .MR.Description}}<pre>{{.MR.Description}}</pre>{{end}}
28 <h2>Commits</h2>
29 <pre>{{if .Diff}}{{.Diff}}{{else}}geen commits vóór de doelbranch, of de branch ontbreekt{{end}}</pre>
30 {{if .CanMerge}}
31 <form method="post" action="/{{.Repo.FullPath}}/-/merge-requests/{{.MR.Number}}/merge">
32 <input type="hidden" name="csrf" value="{{.CSRF}}"><button type="submit">Samenvoegen</button>
33 </form>
34 {{end}}
35 {{if and .User (eq .MR.Status "open")}}
36 <form method="post" action="/{{.Repo.FullPath}}/-/merge-requests/{{.MR.Number}}/close">
37 <input type="hidden" name="csrf" value="{{.CSRF}}"><button class="ghost" type="submit">Sluiten</button>
38 </form>
39 {{end}}
40 {{template "layout-end" .}}
41 {{end}}
42
43 {{define "pipelines"}}
44 {{template "layout-start" .}}
45 <h1>Pipelines</h1>
46 {{template "repotabs" .}}
47 {{if .CanWrite}}
48 <form method="post" action="/{{.Repo.FullPath}}/-/pipelines" class="row">
49 <input type="hidden" name="csrf" value="{{.CSRF}}">
50 <input name="ref" placeholder="branch, leeg is de standaard">
51 <button type="submit">Starten</button>
52 </form>
53 {{end}}
54 <ul class="clean">
55 {{range .Pipes}}<li><a href="/{{$.Repo.FullPath}}/-/pipelines/{{.ID}}">#{{.ID}}</a> <span class="pill">{{.Status}}</span> <span class="muted">{{.Ref}} {{short .CommitSHA}}</span></li>{{else}}<li class="muted">Nog geen pipelines. Voeg <code>blue-ci-cd.yml</code> toe in de root.</li>{{end}}
56 </ul>
57 {{template "layout-end" .}}
58 {{end}}
59
60 {{define "pipeline"}}
61 {{template "layout-start" .}}
62 <h1>Pipeline #{{.Pipe.ID}}</h1>
63 {{template "repotabs" .}}
64 <p><span class="pill">{{.Pipe.Status}}</span> {{.Pipe.Ref}} <code>{{.Pipe.CommitSHA}}</code></p>
65 {{range .Jobs}}
66 <article class="panel">
67 <h2>{{.Name}} <span class="pill">{{.Status}}</span> <span class="muted">{{.Stage}} · {{.Image}}</span></h2>
68 {{if .Log}}<pre>{{.Log}}</pre>{{end}}
69 </article>
70 {{end}}
71 {{template "layout-end" .}}
72 {{end}}
73
74 {{define "releases"}}
75 {{template "layout-start" .}}
76 <h1>Releases</h1>
77 {{template "repotabs" .}}
78 {{range .Releases}}
79 <article class="panel">
80 <h2>{{.Name}} <span class="pill">{{.Tag}}</span></h2>
81 <p class="muted">{{short .CommitSHA}}</p>
82 {{if .Body}}<pre>{{.Body}}</pre>{{end}}
83 <ul>
84 {{$tag := .Tag}}{{$path := $.Repo.FullPath}}
85 {{range .Assets}}<li><a href="/{{$path}}/-/releases/{{$tag}}/assets/{{.Name}}">{{.Name}}</a> <span class="muted">{{.Size}} bytes</span></li>{{end}}
86 </ul>
87 </article>
88 {{else}}<p class="muted">Nog geen releases.</p>{{end}}
89 {{template "layout-end" .}}
90 {{end}}
91
92 {{define "settings"}}
93 {{template "layout-start" .}}
94 <h1>Instellingen</h1>
95 {{template "repotabs" .}}
96 {{if not .CanAdmin}}<p>Alleen een beheerder wijzigt instellingen, geheimen en webhooks. Jouw rol: {{.Role.Label}}.</p>{{end}}
97 {{if .CanAdmin}}
98 <p class="sub">
99 <a href="?tab=algemeen">Algemeen</a>
100 <a href="?tab=leden">Leden</a>
101 <a href="?tab=branches">Branches</a>
102 <a href="?tab=geheimen">Geheimen</a>
103 <a href="?tab=webhooks">Webhooks</a>
104 </p>
105 {{if eq .Tab "leden"}}
106 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/members">
107 <input type="hidden" name="csrf" value="{{.CSRF}}">
108 <div class="row">
109 <input name="username" placeholder="gebruikersnaam" required>
110 <select name="role"><option value="readonly">Alleen lezen</option><option value="developer">Ontwikkelaar</option><option value="maintainer">Beheerder</option></select>
111 <button type="submit">Opslaan</button>
112 </div>
113 </form>
114 <ul class="clean">
115 {{range .Members}}<li>{{.Username}} · {{.Role.Label}} {{if .Pending}}<span class="pill">wacht op eerste aanmelding</span>{{end}}
116 {{if not .Pending}}<form method="post" action="/{{$.Repo.FullPath}}/-/members/remove"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="username" value="{{.Username}}"><button class="ghost" type="submit">Weg</button></form>{{end}}
117 </li>{{end}}
118 </ul>
119 {{else if eq .Tab "branches"}}
120 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/protected">
121 <input type="hidden" name="csrf" value="{{.CSRF}}">
122 <div class="row"><input name="pattern" placeholder="master of release/*" required><button type="submit">Beschermen</button></div>
123 </form>
124 <ul class="clean">{{range .Patterns}}<li><code>{{.}}</code>
125 <form method="post" action="/{{$.Repo.FullPath}}/-/protected/remove"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="pattern" value="{{.}}"><button class="ghost" type="submit">Weg</button></form>
126 </li>{{end}}</ul>
127 <p class="muted">Ontwikkelaars kunnen niet naar deze branches pushen.</p>
128 {{else if eq .Tab "geheimen"}}
129 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/secrets">
130 <input type="hidden" name="csrf" value="{{.CSRF}}">
131 <label>Naam <input name="name" placeholder="DEPLOY_SSH_KEY" required></label>
132 <label>Waarde <textarea name="value" required></textarea></label>
133 <label class="row"><input type="checkbox" name="protected" value="1"> Alleen meesturen op een beschermde branch</label>
134 <button type="submit">Opslaan</button>
135 </form>
136 <ul class="clean">{{range .Secrets}}<li><code>{{.Name}}</code> {{if .Protected}}<span class="pill">beschermd</span>{{end}}
137 <form method="post" action="/{{$.Repo.FullPath}}/-/secrets/delete"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="name" value="{{.Name}}"><button class="ghost" type="submit">Weg</button></form>
138 </li>{{end}}</ul>
139 <p class="muted">Waarden worden niet teruggetoond.</p>
140 {{else if eq .Tab "webhooks"}}
141 {{template "webhookform" .}}
142 {{else}}
143 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/settings">
144 <input type="hidden" name="csrf" value="{{.CSRF}}">
145 <label>Beschrijving <input name="description" value="{{.Repo.Description}}"></label>
146 <label>Zichtbaarheid <select name="visibility"><option value="private" {{if eq .Repo.Visibility "private"}}selected{{end}}>Privé</option><option value="public" {{if eq .Repo.Visibility "public"}}selected{{end}}>Openbaar</option></select></label>
147 <button type="submit">Opslaan</button>
148 </form>
149 <form class="panel" method="post" action="/{{.Repo.FullPath}}/-/delete">
150 <h2>Verwijderen</h2>
151 <input type="hidden" name="csrf" value="{{.CSRF}}">
152 <label>Typ {{.Repo.Name}} <input name="confirm"></label>
153 <button type="submit">Repository verwijderen</button>
154 </form>
155 {{end}}
156 {{end}}
157 {{template "layout-end" .}}
158 {{end}}
159
160 {{define "webhookform"}}
161 <form class="panel" method="post" action="{{if .Repo}}/{{.Repo.FullPath}}/-/webhooks{{else}}/groups/{{.Group.Path}}/webhooks{{end}}">
162 <input type="hidden" name="csrf" value="{{.CSRF}}">
163 <label>Naam <input name="name" required></label>
164 <label>Preset
165 <select name="preset">
166 <option value="generic">Generieke JSON</option>
167 <option value="discord">Discord</option>
168 <option value="grok">Grok Bot</option>
169 </select>
170 </label>
171 <label>URL <input name="url" placeholder="https://example.test/hook" required></label>
172 <label>Branchfilter voor push <input name="branch_filter" placeholder="leeg, master, of re:^release/.*"></label>
173 <label>Headers, één per regel <textarea name="headers" placeholder="Authorization: Bearer secret.GROK_TOKEN tussen dubbele accolades"></textarea></label>
174 <label>Body-sjabloon, leeg is de gebeurtenis als JSON <textarea name="body" placeholder="Discord: een JSON-object met content"></textarea></label>
175 <fieldset>
176 <label><input type="checkbox" name="event_push" value="1"> push</label>
177 <label><input type="checkbox" name="event_merge_request" value="1"> merge request</label>
178 <label><input type="checkbox" name="event_pipeline_success" value="1"> pipeline geslaagd</label>
179 <label><input type="checkbox" name="event_pipeline_failure" value="1"> pipeline mislukt</label>
180 <label><input type="checkbox" name="event_release_published" value="1"> release gepubliceerd</label>
181 </fieldset>
182 <button type="submit">Webhook opslaan</button>
183 </form>
184 <ul class="clean">
185 {{range .Hooks}}<li><strong>{{.Name}}</strong> {{.Preset}} <span class="muted">{{.URL}}</span>
186 <div class="muted">{{.Events}} {{if .Filter}}· filter {{.Filter}}{{end}}</div>
187 {{range .Deliveries}}<div class="muted">{{.EventType}} → {{.StatusCode}} {{.Error}}</div>{{end}}
188 <form method="post" action="{{if $.Repo}}/{{$.Repo.FullPath}}/-/webhooks/delete{{else}}/groups/{{$.Group.Path}}/webhooks/delete{{end}}">
189 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
190 <button class="ghost" type="submit">Weg</button>
191 </form>
192 </li>{{end}}
193 </ul>
194 {{end}}
195
196 {{define "group"}}
197 {{template "layout-start" .}}
198 <h1>{{.Group.Name}}</h1>
199 <p class="muted">{{.Group.Path}} · {{.Group.Description}}</p>
200 <h2>Repositories</h2>
201 <ul class="clean">{{range .Repos}}<li><a href="/{{.FullPath}}">{{.Name}}</a></li>{{else}}<li class="muted">Nog geen repositories.</li>{{end}}</ul>
202 {{if .CanAdmin}}
203 <h2>Leden</h2>
204 <form class="panel" method="post" action="/groups/{{.Group.Path}}/members">
205 <input type="hidden" name="csrf" value="{{.CSRF}}">
206 <div class="row">
207 <input name="username" placeholder="gebruikersnaam" required>
208 <select name="role"><option value="readonly">Alleen lezen</option><option value="developer">Ontwikkelaar</option><option value="maintainer">Beheerder</option></select>
209 <button type="submit">Opslaan</button>
210 </div>
211 </form>
212 <ul class="clean">{{range .Members}}<li>{{.Username}} · {{.Role.Label}} {{if .Pending}}<span class="pill">wacht</span>{{end}}</li>{{end}}</ul>
213 <h2>Geheimen</h2>
214 <form class="panel" method="post" action="/groups/{{.Group.Path}}/secrets">
215 <input type="hidden" name="csrf" value="{{.CSRF}}">
216 <label>Naam <input name="name" required></label>
217 <label>Waarde <textarea name="value" required></textarea></label>
218 <label class="row"><input type="checkbox" name="protected" value="1"> Alleen op een beschermde branch</label>
219 <button type="submit">Opslaan</button>
220 </form>
221 <ul class="clean">{{range .Secrets}}<li><code>{{.Name}}</code></li>{{end}}</ul>
222 <h2>Webhooks</h2>
223 <p class="muted">Alleen geheimen van deze groep.</p>
224 {{template "webhookform" .}}
225 {{end}}
226 {{template "layout-end" .}}
227 {{end}}
@@ -0,0 +1,227 @@
1{{define "mrs"}}
2{{template "layout-start" .}}
3<h1>Merge requests</h1>
4{{template "repotabs" .}}
5<ul class="clean">
6 {{range .MRs}}<li><a href="/{{$.Repo.FullPath}}/-/merge-requests/{{.Number}}">!{{.Number}} {{.Title}}</a> <span class="pill">{{.Status}}</span> <span class="muted">{{.SourceBranch}} → {{.TargetBranch}}</span></li>{{else}}<li class="muted">Geen merge requests.</li>{{end}}
7</ul>
8{{if .CanWrite}}
9<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/merge-requests">
10 <h2>Nieuw</h2>
11 <input type="hidden" name="csrf" value="{{.CSRF}}">
12 <label>Titel <input name="title" required></label>
13 <label>Beschrijving <textarea name="description"></textarea></label>
14 <label>Bron <select name="source">{{range .Branches}}<option>{{.Name}}</option>{{end}}</select></label>
15 <label>Doel <select name="target">{{range .Branches}}<option>{{.Name}}</option>{{end}}</select></label>
16 <button type="submit">Openen</button>
17</form>
18{{end}}
19{{template "layout-end" .}}
20{{end}}
21
22{{define "mr"}}
23{{template "layout-start" .}}
24<h1>!{{.MR.Number}} {{.MR.Title}}</h1>
25{{template "repotabs" .}}
26<p><span class="pill">{{.MR.Status}}</span> {{.MR.SourceBranch}} → {{.MR.TargetBranch}} · {{.MR.Author}}</p>
27{{if .MR.Description}}<pre>{{.MR.Description}}</pre>{{end}}
28<h2>Commits</h2>
29<pre>{{if .Diff}}{{.Diff}}{{else}}geen commits vóór de doelbranch, of de branch ontbreekt{{end}}</pre>
30{{if .CanMerge}}
31<form method="post" action="/{{.Repo.FullPath}}/-/merge-requests/{{.MR.Number}}/merge">
32 <input type="hidden" name="csrf" value="{{.CSRF}}"><button type="submit">Samenvoegen</button>
33</form>
34{{end}}
35{{if and .User (eq .MR.Status "open")}}
36<form method="post" action="/{{.Repo.FullPath}}/-/merge-requests/{{.MR.Number}}/close">
37 <input type="hidden" name="csrf" value="{{.CSRF}}"><button class="ghost" type="submit">Sluiten</button>
38</form>
39{{end}}
40{{template "layout-end" .}}
41{{end}}
42
43{{define "pipelines"}}
44{{template "layout-start" .}}
45<h1>Pipelines</h1>
46{{template "repotabs" .}}
47{{if .CanWrite}}
48<form method="post" action="/{{.Repo.FullPath}}/-/pipelines" class="row">
49 <input type="hidden" name="csrf" value="{{.CSRF}}">
50 <input name="ref" placeholder="branch, leeg is de standaard">
51 <button type="submit">Starten</button>
52</form>
53{{end}}
54<ul class="clean">
55 {{range .Pipes}}<li><a href="/{{$.Repo.FullPath}}/-/pipelines/{{.ID}}">#{{.ID}}</a> <span class="pill">{{.Status}}</span> <span class="muted">{{.Ref}} {{short .CommitSHA}}</span></li>{{else}}<li class="muted">Nog geen pipelines. Voeg <code>blue-ci-cd.yml</code> toe in de root.</li>{{end}}
56</ul>
57{{template "layout-end" .}}
58{{end}}
59
60{{define "pipeline"}}
61{{template "layout-start" .}}
62<h1>Pipeline #{{.Pipe.ID}}</h1>
63{{template "repotabs" .}}
64<p><span class="pill">{{.Pipe.Status}}</span> {{.Pipe.Ref}} <code>{{.Pipe.CommitSHA}}</code></p>
65{{range .Jobs}}
66<article class="panel">
67 <h2>{{.Name}} <span class="pill">{{.Status}}</span> <span class="muted">{{.Stage}} · {{.Image}}</span></h2>
68 {{if .Log}}<pre>{{.Log}}</pre>{{end}}
69</article>
70{{end}}
71{{template "layout-end" .}}
72{{end}}
73
74{{define "releases"}}
75{{template "layout-start" .}}
76<h1>Releases</h1>
77{{template "repotabs" .}}
78{{range .Releases}}
79<article class="panel">
80 <h2>{{.Name}} <span class="pill">{{.Tag}}</span></h2>
81 <p class="muted">{{short .CommitSHA}}</p>
82 {{if .Body}}<pre>{{.Body}}</pre>{{end}}
83 <ul>
84 {{$tag := .Tag}}{{$path := $.Repo.FullPath}}
85 {{range .Assets}}<li><a href="/{{$path}}/-/releases/{{$tag}}/assets/{{.Name}}">{{.Name}}</a> <span class="muted">{{.Size}} bytes</span></li>{{end}}
86 </ul>
87</article>
88{{else}}<p class="muted">Nog geen releases.</p>{{end}}
89{{template "layout-end" .}}
90{{end}}
91
92{{define "settings"}}
93{{template "layout-start" .}}
94<h1>Instellingen</h1>
95{{template "repotabs" .}}
96{{if not .CanAdmin}}<p>Alleen een beheerder wijzigt instellingen, geheimen en webhooks. Jouw rol: {{.Role.Label}}.</p>{{end}}
97{{if .CanAdmin}}
98<p class="sub">
99 <a href="?tab=algemeen">Algemeen</a>
100 <a href="?tab=leden">Leden</a>
101 <a href="?tab=branches">Branches</a>
102 <a href="?tab=geheimen">Geheimen</a>
103 <a href="?tab=webhooks">Webhooks</a>
104</p>
105{{if eq .Tab "leden"}}
106<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/members">
107 <input type="hidden" name="csrf" value="{{.CSRF}}">
108 <div class="row">
109 <input name="username" placeholder="gebruikersnaam" required>
110 <select name="role"><option value="readonly">Alleen lezen</option><option value="developer">Ontwikkelaar</option><option value="maintainer">Beheerder</option></select>
111 <button type="submit">Opslaan</button>
112 </div>
113</form>
114<ul class="clean">
115 {{range .Members}}<li>{{.Username}} · {{.Role.Label}} {{if .Pending}}<span class="pill">wacht op eerste aanmelding</span>{{end}}
116 {{if not .Pending}}<form method="post" action="/{{$.Repo.FullPath}}/-/members/remove"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="username" value="{{.Username}}"><button class="ghost" type="submit">Weg</button></form>{{end}}
117 </li>{{end}}
118</ul>
119{{else if eq .Tab "branches"}}
120<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/protected">
121 <input type="hidden" name="csrf" value="{{.CSRF}}">
122 <div class="row"><input name="pattern" placeholder="master of release/*" required><button type="submit">Beschermen</button></div>
123</form>
124<ul class="clean">{{range .Patterns}}<li><code>{{.}}</code>
125 <form method="post" action="/{{$.Repo.FullPath}}/-/protected/remove"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="pattern" value="{{.}}"><button class="ghost" type="submit">Weg</button></form>
126</li>{{end}}</ul>
127<p class="muted">Ontwikkelaars kunnen niet naar deze branches pushen.</p>
128{{else if eq .Tab "geheimen"}}
129<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/secrets">
130 <input type="hidden" name="csrf" value="{{.CSRF}}">
131 <label>Naam <input name="name" placeholder="DEPLOY_SSH_KEY" required></label>
132 <label>Waarde <textarea name="value" required></textarea></label>
133 <label class="row"><input type="checkbox" name="protected" value="1"> Alleen meesturen op een beschermde branch</label>
134 <button type="submit">Opslaan</button>
135</form>
136<ul class="clean">{{range .Secrets}}<li><code>{{.Name}}</code> {{if .Protected}}<span class="pill">beschermd</span>{{end}}
137 <form method="post" action="/{{$.Repo.FullPath}}/-/secrets/delete"><input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="name" value="{{.Name}}"><button class="ghost" type="submit">Weg</button></form>
138</li>{{end}}</ul>
139<p class="muted">Waarden worden niet teruggetoond.</p>
140{{else if eq .Tab "webhooks"}}
141{{template "webhookform" .}}
142{{else}}
143<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/settings">
144 <input type="hidden" name="csrf" value="{{.CSRF}}">
145 <label>Beschrijving <input name="description" value="{{.Repo.Description}}"></label>
146 <label>Zichtbaarheid <select name="visibility"><option value="private" {{if eq .Repo.Visibility "private"}}selected{{end}}>Privé</option><option value="public" {{if eq .Repo.Visibility "public"}}selected{{end}}>Openbaar</option></select></label>
147 <button type="submit">Opslaan</button>
148</form>
149<form class="panel" method="post" action="/{{.Repo.FullPath}}/-/delete">
150 <h2>Verwijderen</h2>
151 <input type="hidden" name="csrf" value="{{.CSRF}}">
152 <label>Typ {{.Repo.Name}} <input name="confirm"></label>
153 <button type="submit">Repository verwijderen</button>
154</form>
155{{end}}
156{{end}}
157{{template "layout-end" .}}
158{{end}}
159
160{{define "webhookform"}}
161<form class="panel" method="post" action="{{if .Repo}}/{{.Repo.FullPath}}/-/webhooks{{else}}/groups/{{.Group.Path}}/webhooks{{end}}">
162 <input type="hidden" name="csrf" value="{{.CSRF}}">
163 <label>Naam <input name="name" required></label>
164 <label>Preset
165 <select name="preset">
166 <option value="generic">Generieke JSON</option>
167 <option value="discord">Discord</option>
168 <option value="grok">Grok Bot</option>
169 </select>
170 </label>
171 <label>URL <input name="url" placeholder="https://example.test/hook" required></label>
172 <label>Branchfilter voor push <input name="branch_filter" placeholder="leeg, master, of re:^release/.*"></label>
173 <label>Headers, één per regel <textarea name="headers" placeholder="Authorization: Bearer secret.GROK_TOKEN tussen dubbele accolades"></textarea></label>
174 <label>Body-sjabloon, leeg is de gebeurtenis als JSON <textarea name="body" placeholder="Discord: een JSON-object met content"></textarea></label>
175 <fieldset>
176 <label><input type="checkbox" name="event_push" value="1"> push</label>
177 <label><input type="checkbox" name="event_merge_request" value="1"> merge request</label>
178 <label><input type="checkbox" name="event_pipeline_success" value="1"> pipeline geslaagd</label>
179 <label><input type="checkbox" name="event_pipeline_failure" value="1"> pipeline mislukt</label>
180 <label><input type="checkbox" name="event_release_published" value="1"> release gepubliceerd</label>
181 </fieldset>
182 <button type="submit">Webhook opslaan</button>
183</form>
184<ul class="clean">
185 {{range .Hooks}}<li><strong>{{.Name}}</strong> {{.Preset}} <span class="muted">{{.URL}}</span>
186 <div class="muted">{{.Events}} {{if .Filter}}· filter {{.Filter}}{{end}}</div>
187 {{range .Deliveries}}<div class="muted">{{.EventType}} → {{.StatusCode}} {{.Error}}</div>{{end}}
188 <form method="post" action="{{if $.Repo}}/{{$.Repo.FullPath}}/-/webhooks/delete{{else}}/groups/{{$.Group.Path}}/webhooks/delete{{end}}">
189 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
190 <button class="ghost" type="submit">Weg</button>
191 </form>
192 </li>{{end}}
193</ul>
194{{end}}
195
196{{define "group"}}
197{{template "layout-start" .}}
198<h1>{{.Group.Name}}</h1>
199<p class="muted">{{.Group.Path}} · {{.Group.Description}}</p>
200<h2>Repositories</h2>
201<ul class="clean">{{range .Repos}}<li><a href="/{{.FullPath}}">{{.Name}}</a></li>{{else}}<li class="muted">Nog geen repositories.</li>{{end}}</ul>
202{{if .CanAdmin}}
203<h2>Leden</h2>
204<form class="panel" method="post" action="/groups/{{.Group.Path}}/members">
205 <input type="hidden" name="csrf" value="{{.CSRF}}">
206 <div class="row">
207 <input name="username" placeholder="gebruikersnaam" required>
208 <select name="role"><option value="readonly">Alleen lezen</option><option value="developer">Ontwikkelaar</option><option value="maintainer">Beheerder</option></select>
209 <button type="submit">Opslaan</button>
210 </div>
211</form>
212<ul class="clean">{{range .Members}}<li>{{.Username}} · {{.Role.Label}} {{if .Pending}}<span class="pill">wacht</span>{{end}}</li>{{end}}</ul>
213<h2>Geheimen</h2>
214<form class="panel" method="post" action="/groups/{{.Group.Path}}/secrets">
215 <input type="hidden" name="csrf" value="{{.CSRF}}">
216 <label>Naam <input name="name" required></label>
217 <label>Waarde <textarea name="value" required></textarea></label>
218 <label class="row"><input type="checkbox" name="protected" value="1"> Alleen op een beschermde branch</label>
219 <button type="submit">Opslaan</button>
220</form>
221<ul class="clean">{{range .Secrets}}<li><code>{{.Name}}</code></li>{{end}}</ul>
222<h2>Webhooks</h2>
223<p class="muted">Alleen geheimen van deze groep.</p>
224{{template "webhookform" .}}
225{{end}}
226{{template "layout-end" .}}
227{{end}}
internal/server/templates/layout.html added +47 −0
@@ -0,0 +1,47 @@
1 {{define "layout-start"}}
2 <!DOCTYPE html>
3 <html lang="nl">
4 <head>
5 <meta charset="utf-8">
6 <meta name="viewport" content="width=device-width, initial-scale=1">
7 <title>{{if .Title}}{{.Title}} · {{end}}BlueGit</title>
8 <link rel="icon" href="/assets/logo.svg" type="image/svg+xml">
9 <link rel="stylesheet" href="/assets/style.css">
10 </head>
11 <body>
12 <header class="top">
13 <a class="brand" href="/"><img src="/assets/logo.svg" alt=""> BlueGit</a>
14 <nav>
15 {{if .User}}
16 <a href="/">Overzicht</a>
17 <a href="/new">Nieuw</a>
18 {{if .User.InstanceAdmin}}<a href="/setup">Opslag</a>{{end}}
19 <a href="/settings">{{.User.Username}}</a>
20 <form method="post" action="/logout"><input type="hidden" name="csrf" value="{{.CSRF}}"><button type="submit">Afmelden</button></form>
21 {{else}}
22 <a class="btn" href="/login">Aanmelden</a>
23 {{end}}
24 </nav>
25 </header>
26 <main>
27 {{if .Notice}}<p class="flash">{{.Notice}}</p>{{end}}
28 {{if .Err}}<p class="flash bad">{{.Err}}</p>{{end}}
29 {{end}}
30
31 {{define "layout-end"}}
32 </main>
33 </body>
34 </html>
35 {{end}}
36
37 {{define "repotabs"}}
38 <p class="sub">
39 <a href="/{{.Repo.FullPath}}">Bestanden</a>
40 <a href="/{{.Repo.FullPath}}/-/commits">Commits</a>
41 <a href="/{{.Repo.FullPath}}/-/branches">Branches</a>
42 <a href="/{{.Repo.FullPath}}/-/merge-requests">Merge requests</a>
43 <a href="/{{.Repo.FullPath}}/-/pipelines">Pipelines</a>
44 <a href="/{{.Repo.FullPath}}/-/releases">Releases</a>
45 {{if .CanAdmin}}<a href="/{{.Repo.FullPath}}/-/settings">Instellingen</a>{{end}}
46 </p>
47 {{end}}
@@ -0,0 +1,47 @@
1{{define "layout-start"}}
2<!DOCTYPE html>
3<html lang="nl">
4<head>
5 <meta charset="utf-8">
6 <meta name="viewport" content="width=device-width, initial-scale=1">
7 <title>{{if .Title}}{{.Title}} · {{end}}BlueGit</title>
8 <link rel="icon" href="/assets/logo.svg" type="image/svg+xml">
9 <link rel="stylesheet" href="/assets/style.css">
10</head>
11<body>
12<header class="top">
13 <a class="brand" href="/"><img src="/assets/logo.svg" alt=""> BlueGit</a>
14 <nav>
15 {{if .User}}
16 <a href="/">Overzicht</a>
17 <a href="/new">Nieuw</a>
18 {{if .User.InstanceAdmin}}<a href="/setup">Opslag</a>{{end}}
19 <a href="/settings">{{.User.Username}}</a>
20 <form method="post" action="/logout"><input type="hidden" name="csrf" value="{{.CSRF}}"><button type="submit">Afmelden</button></form>
21 {{else}}
22 <a class="btn" href="/login">Aanmelden</a>
23 {{end}}
24 </nav>
25</header>
26<main>
27{{if .Notice}}<p class="flash">{{.Notice}}</p>{{end}}
28{{if .Err}}<p class="flash bad">{{.Err}}</p>{{end}}
29{{end}}
30
31{{define "layout-end"}}
32</main>
33</body>
34</html>
35{{end}}
36
37{{define "repotabs"}}
38<p class="sub">
39 <a href="/{{.Repo.FullPath}}">Bestanden</a>
40 <a href="/{{.Repo.FullPath}}/-/commits">Commits</a>
41 <a href="/{{.Repo.FullPath}}/-/branches">Branches</a>
42 <a href="/{{.Repo.FullPath}}/-/merge-requests">Merge requests</a>
43 <a href="/{{.Repo.FullPath}}/-/pipelines">Pipelines</a>
44 <a href="/{{.Repo.FullPath}}/-/releases">Releases</a>
45 {{if .CanAdmin}}<a href="/{{.Repo.FullPath}}/-/settings">Instellingen</a>{{end}}
46</p>
47{{end}}
internal/server/templates/pages.html added +204 −0
@@ -0,0 +1,204 @@
1 {{define "setup"}}
2 {{template "layout-start" .}}
3 <h1>{{if .StorageUnset}}Opslag kiezen{{else}}Opslagpad{{end}}</h1>
4 {{if not .StorageUnset}}
5 <p class="flash bad">Het pad wijzigen verplaatst geen repositories, artifacts of releases.</p>
6 {{end}}
7 <section class="panel">
8 {{if .StorageFree}}<p>Vrije ruimte: <strong>{{.StorageFree}}</strong> van {{.StorageTotal}}.</p>{{end}}
9 <form method="post" action="/setup">
10 <input type="hidden" name="csrf" value="{{.CSRF}}">
11 <label>Pad op de schijf
12 <input name="path" value="{{.StoragePath}}" required placeholder="/absoluut/pad">
13 </label>
14 <button type="submit">Opslaan</button>
15 </form>
16 <p class="muted">Het pad moet bestaan, beschrijfbaar zijn en minstens {{.MinFree}} vrij hebben.</p>
17 </section>
18 {{template "layout-end" .}}
19 {{end}}
20
21 {{define "home"}}
22 {{template "layout-start" .}}
23 <section class="hero">
24 <img src="/assets/logo.svg" alt="BlueGit">
25 <div>
26 <h1>BlueGit</h1>
27 <p>Meld je aan om repositories te bekijken.</p>
28 {{if .StorageUnset}}<p class="flash bad">Opslag is nog niet ingesteld. Repositories zijn tijdelijk niet beschikbaar.</p>{{end}}
29 <p><a class="btn" href="/login">Aanmelden</a></p>
30 </div>
31 </section>
32 {{if .Repos}}
33 <section class="panel">
34 <h2>Openbare repositories</h2>
35 <ul class="clean">
36 {{range .Repos}}<li><a href="/{{.FullPath}}">{{.FullPath}}</a> <span class="muted">{{.Description}}</span></li>{{end}}
37 </ul>
38 </section>
39 {{end}}
40 {{template "layout-end" .}}
41 {{end}}
42
43 {{define "dashboard"}}
44 {{template "layout-start" .}}
45 <h1>Overzicht</h1>
46 {{if .StorageUnset}}<p class="flash bad">Opslag is nog niet ingesteld. Repositories zijn tijdelijk niet beschikbaar.</p>{{end}}
47 <div class="grid-2">
48 <section class="panel">
49 <h2>Repositories</h2>
50 {{if not .Repos}}<p class="muted">Nog geen repositories.</p>{{end}}
51 <ul class="clean">
52 {{range .Repos}}<li><a href="/{{.FullPath}}">{{.FullPath}}</a> <span class="pill">{{.Visibility}}</span><div class="muted">{{.Description}}</div></li>{{end}}
53 </ul>
54 </section>
55 <section class="panel">
56 <h2>Groepen</h2>
57 {{if not .Groups}}<p class="muted">Nog geen groepen.</p>{{end}}
58 <ul class="clean">
59 {{range .Groups}}<li><a href="/groups/{{.Path}}">{{.Name}}</a> <span class="muted">{{.Path}}</span></li>{{end}}
60 </ul>
61 </section>
62 </div>
63 {{template "layout-end" .}}
64 {{end}}
65
66 {{define "new"}}
67 {{template "layout-start" .}}
68 <h1>Nieuw</h1>
69 <div class="grid-2">
70 <form class="panel" method="post" action="/new/repo">
71 <h2>Repository</h2>
72 <input type="hidden" name="csrf" value="{{.CSRF}}">
73 <label>Naam <input name="name" required pattern="[A-Za-z0-9][A-Za-z0-9._-]{0,62}"></label>
74 <label>Beschrijving <input name="description"></label>
75 <label>Eigenaar
76 <select name="group">
77 <option value="">Ikzelf</option>
78 {{range .Groups}}<option value="{{.Path}}">{{.Name}}</option>{{end}}
79 </select>
80 </label>
81 <label>Zichtbaarheid
82 <select name="visibility"><option value="private">Privé</option><option value="public">Openbaar</option></select>
83 </label>
84 <button type="submit">Aanmaken</button>
85 </form>
86 <form class="panel" method="post" action="/new/group">
87 <h2>Groep</h2>
88 <input type="hidden" name="csrf" value="{{.CSRF}}">
89 <label>Naam <input name="name" required></label>
90 <label>Pad <input name="path" required pattern="[a-z][a-z0-9_-]{0,62}"></label>
91 <label>Beschrijving <input name="description"></label>
92 <button type="submit">Aanmaken</button>
93 </form>
94 </div>
95 {{template "layout-end" .}}
96 {{end}}
97
98 {{define "account"}}
99 {{template "layout-start" .}}
100 <h1>Account</h1>
101 <p class="muted">Voor git via HTTPS: je gebruikersnaam en een token als wachtwoord.</p>
102 {{if .NewToken}}<p class="code">{{.NewToken}}</p>{{end}}
103 <section class="panel">
104 <h2>Toegangstokens</h2>
105 <form method="post" action="/settings/tokens">
106 <input type="hidden" name="csrf" value="{{.CSRF}}">
107 <div class="row"><input name="name" placeholder="naam, bijvoorbeeld laptop" required><button type="submit">Nieuw token</button></div>
108 </form>
109 <ul class="clean">
110 {{range .Tokens}}<li>{{.Name}} <span class="muted">{{.Prefix}}…</span>
111 <form method="post" action="/settings/tokens/delete" class="row">
112 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
113 <button class="ghost" type="submit">Intrekken</button>
114 </form>
115 </li>{{end}}
116 </ul>
117 </section>
118 <section class="panel">
119 <h2>SSH-sleutels</h2>
120 <form method="post" action="/settings/ssh">
121 <input type="hidden" name="csrf" value="{{.CSRF}}">
122 <label>Naam <input name="name" placeholder="laptop"></label>
123 <label>Publieke sleutel <textarea name="key" placeholder="ssh-ed25519 AAAA... " required></textarea></label>
124 <button type="submit">Toevoegen</button>
125 </form>
126 <ul class="clean">
127 {{range .Keys}}<li>{{.Name}} <span class="muted">{{.Fingerprint}}</span>
128 <form method="post" action="/settings/ssh/delete">
129 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
130 <button class="ghost" type="submit">Verwijderen</button>
131 </form>
132 </li>{{end}}
133 </ul>
134 </section>
135 <p><a href="/settings/export">Gegevens downloaden (JSON)</a></p>
136 {{template "layout-end" .}}
137 {{end}}
138
139 {{define "repo"}}
140 {{template "layout-start" .}}
141 <h1>{{.Repo.FullPath}}</h1>
142 {{template "repotabs" .}}
143 <p>{{.Repo.Description}}</p>
144 <p class="code">git clone {{.CloneHTTP}}{{if .CloneSSH}}
145 git clone {{.CloneSSH}}{{end}}</p>
146 <p class="muted">HTTPS: gebruik je gebruikersnaam en een toegangstoken als wachtwoord. Branch {{.Rev}}.</p>
147 {{if not .Commits}}<p class="panel">Nog geen commits.</p>{{end}}
148 <ul class="clean">
149 {{range .Entries}}<li>{{if eq .Type "tree"}}<a href="/{{$.Repo.FullPath}}/-/tree/{{.Path}}?rev={{$.Rev}}">{{.Name}}/</a>{{else}}<a href="/{{$.Repo.FullPath}}/-/blob/{{.Path}}?rev={{$.Rev}}">{{.Name}}</a>{{end}}</li>{{end}}
150 </ul>
151 <h2>Recente commits</h2>
152 <ul class="clean">
153 {{range .Commits}}<li><a href="/{{$.Repo.FullPath}}/-/commit/{{.SHA}}">{{.Short}}</a> {{.Subject}} <span class="muted">{{.Author}} · {{.Date}}</span></li>{{end}}
154 </ul>
155 {{template "layout-end" .}}
156 {{end}}
157
158 {{define "tree"}}
159 {{template "layout-start" .}}
160 <h1>{{.Repo.Name}}</h1>
161 {{template "repotabs" .}}
162 <p class="muted">{{.TreePath}}</p>
163 <ul class="clean">
164 {{range .Entries}}<li>{{if eq .Type "tree"}}<a href="/{{$.Repo.FullPath}}/-/tree/{{.Path}}?rev={{$.Rev}}">{{.Name}}/</a>{{else}}<a href="/{{$.Repo.FullPath}}/-/blob/{{.Path}}?rev={{$.Rev}}">{{.Name}}</a>{{end}}</li>{{end}}
165 </ul>
166 {{template "layout-end" .}}
167 {{end}}
168
169 {{define "blob"}}
170 {{template "layout-start" .}}
171 <h1>{{.BlobPath}}</h1>
172 {{template "repotabs" .}}
173 {{if .Binary}}<p>Binair bestand, niet getoond.</p>{{else}}<pre>{{.Blob}}</pre>{{end}}
174 {{template "layout-end" .}}
175 {{end}}
176
177 {{define "commits"}}
178 {{template "layout-start" .}}
179 <h1>Commits</h1>
180 {{template "repotabs" .}}
181 <ul class="clean">
182 {{range .Commits}}<li><a href="/{{$.Repo.FullPath}}/-/commit/{{.SHA}}">{{.Short}}</a> {{.Subject}} <span class="muted">{{.Author}} · {{.Date}}</span></li>{{else}}<li class="muted">Nog geen commits.</li>{{end}}
183 </ul>
184 {{template "layout-end" .}}
185 {{end}}
186
187 {{define "commit"}}
188 {{template "layout-start" .}}
189 <h1>{{.Commit.Subject}}</h1>
190 {{template "repotabs" .}}
191 <p class="muted">{{.Commit.SHA}} · {{.Commit.Author}} · {{.Commit.Date}}</p>
192 {{if .Commit.Body}}<pre>{{.Commit.Body}}</pre>{{end}}
193 {{template "layout-end" .}}
194 {{end}}
195
196 {{define "branches"}}
197 {{template "layout-start" .}}
198 <h1>Branches</h1>
199 {{template "repotabs" .}}
200 <ul class="clean">
201 {{range .Branches}}<li><a href="/{{$.Repo.FullPath}}?rev={{.Name}}">{{.Name}}</a> {{if .Protected}}<span class="pill">beschermd</span>{{end}}</li>{{else}}<li class="muted">Nog geen branches.</li>{{end}}
202 </ul>
203 {{template "layout-end" .}}
204 {{end}}
@@ -0,0 +1,204 @@
1{{define "setup"}}
2{{template "layout-start" .}}
3<h1>{{if .StorageUnset}}Opslag kiezen{{else}}Opslagpad{{end}}</h1>
4{{if not .StorageUnset}}
5<p class="flash bad">Het pad wijzigen verplaatst geen repositories, artifacts of releases.</p>
6{{end}}
7<section class="panel">
8 {{if .StorageFree}}<p>Vrije ruimte: <strong>{{.StorageFree}}</strong> van {{.StorageTotal}}.</p>{{end}}
9 <form method="post" action="/setup">
10 <input type="hidden" name="csrf" value="{{.CSRF}}">
11 <label>Pad op de schijf
12 <input name="path" value="{{.StoragePath}}" required placeholder="/absoluut/pad">
13 </label>
14 <button type="submit">Opslaan</button>
15 </form>
16 <p class="muted">Het pad moet bestaan, beschrijfbaar zijn en minstens {{.MinFree}} vrij hebben.</p>
17</section>
18{{template "layout-end" .}}
19{{end}}
20
21{{define "home"}}
22{{template "layout-start" .}}
23<section class="hero">
24 <img src="/assets/logo.svg" alt="BlueGit">
25 <div>
26 <h1>BlueGit</h1>
27 <p>Meld je aan om repositories te bekijken.</p>
28 {{if .StorageUnset}}<p class="flash bad">Opslag is nog niet ingesteld. Repositories zijn tijdelijk niet beschikbaar.</p>{{end}}
29 <p><a class="btn" href="/login">Aanmelden</a></p>
30 </div>
31</section>
32{{if .Repos}}
33<section class="panel">
34 <h2>Openbare repositories</h2>
35 <ul class="clean">
36 {{range .Repos}}<li><a href="/{{.FullPath}}">{{.FullPath}}</a> <span class="muted">{{.Description}}</span></li>{{end}}
37 </ul>
38</section>
39{{end}}
40{{template "layout-end" .}}
41{{end}}
42
43{{define "dashboard"}}
44{{template "layout-start" .}}
45<h1>Overzicht</h1>
46{{if .StorageUnset}}<p class="flash bad">Opslag is nog niet ingesteld. Repositories zijn tijdelijk niet beschikbaar.</p>{{end}}
47<div class="grid-2">
48 <section class="panel">
49 <h2>Repositories</h2>
50 {{if not .Repos}}<p class="muted">Nog geen repositories.</p>{{end}}
51 <ul class="clean">
52 {{range .Repos}}<li><a href="/{{.FullPath}}">{{.FullPath}}</a> <span class="pill">{{.Visibility}}</span><div class="muted">{{.Description}}</div></li>{{end}}
53 </ul>
54 </section>
55 <section class="panel">
56 <h2>Groepen</h2>
57 {{if not .Groups}}<p class="muted">Nog geen groepen.</p>{{end}}
58 <ul class="clean">
59 {{range .Groups}}<li><a href="/groups/{{.Path}}">{{.Name}}</a> <span class="muted">{{.Path}}</span></li>{{end}}
60 </ul>
61 </section>
62</div>
63{{template "layout-end" .}}
64{{end}}
65
66{{define "new"}}
67{{template "layout-start" .}}
68<h1>Nieuw</h1>
69<div class="grid-2">
70 <form class="panel" method="post" action="/new/repo">
71 <h2>Repository</h2>
72 <input type="hidden" name="csrf" value="{{.CSRF}}">
73 <label>Naam <input name="name" required pattern="[A-Za-z0-9][A-Za-z0-9._-]{0,62}"></label>
74 <label>Beschrijving <input name="description"></label>
75 <label>Eigenaar
76 <select name="group">
77 <option value="">Ikzelf</option>
78 {{range .Groups}}<option value="{{.Path}}">{{.Name}}</option>{{end}}
79 </select>
80 </label>
81 <label>Zichtbaarheid
82 <select name="visibility"><option value="private">Privé</option><option value="public">Openbaar</option></select>
83 </label>
84 <button type="submit">Aanmaken</button>
85 </form>
86 <form class="panel" method="post" action="/new/group">
87 <h2>Groep</h2>
88 <input type="hidden" name="csrf" value="{{.CSRF}}">
89 <label>Naam <input name="name" required></label>
90 <label>Pad <input name="path" required pattern="[a-z][a-z0-9_-]{0,62}"></label>
91 <label>Beschrijving <input name="description"></label>
92 <button type="submit">Aanmaken</button>
93 </form>
94</div>
95{{template "layout-end" .}}
96{{end}}
97
98{{define "account"}}
99{{template "layout-start" .}}
100<h1>Account</h1>
101<p class="muted">Voor git via HTTPS: je gebruikersnaam en een token als wachtwoord.</p>
102{{if .NewToken}}<p class="code">{{.NewToken}}</p>{{end}}
103<section class="panel">
104 <h2>Toegangstokens</h2>
105 <form method="post" action="/settings/tokens">
106 <input type="hidden" name="csrf" value="{{.CSRF}}">
107 <div class="row"><input name="name" placeholder="naam, bijvoorbeeld laptop" required><button type="submit">Nieuw token</button></div>
108 </form>
109 <ul class="clean">
110 {{range .Tokens}}<li>{{.Name}} <span class="muted">{{.Prefix}}…</span>
111 <form method="post" action="/settings/tokens/delete" class="row">
112 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
113 <button class="ghost" type="submit">Intrekken</button>
114 </form>
115 </li>{{end}}
116 </ul>
117</section>
118<section class="panel">
119 <h2>SSH-sleutels</h2>
120 <form method="post" action="/settings/ssh">
121 <input type="hidden" name="csrf" value="{{.CSRF}}">
122 <label>Naam <input name="name" placeholder="laptop"></label>
123 <label>Publieke sleutel <textarea name="key" placeholder="ssh-ed25519 AAAA... " required></textarea></label>
124 <button type="submit">Toevoegen</button>
125 </form>
126 <ul class="clean">
127 {{range .Keys}}<li>{{.Name}} <span class="muted">{{.Fingerprint}}</span>
128 <form method="post" action="/settings/ssh/delete">
129 <input type="hidden" name="csrf" value="{{$.CSRF}}"><input type="hidden" name="id" value="{{.ID}}">
130 <button class="ghost" type="submit">Verwijderen</button>
131 </form>
132 </li>{{end}}
133 </ul>
134</section>
135<p><a href="/settings/export">Gegevens downloaden (JSON)</a></p>
136{{template "layout-end" .}}
137{{end}}
138
139{{define "repo"}}
140{{template "layout-start" .}}
141<h1>{{.Repo.FullPath}}</h1>
142{{template "repotabs" .}}
143<p>{{.Repo.Description}}</p>
144<p class="code">git clone {{.CloneHTTP}}{{if .CloneSSH}}
145git clone {{.CloneSSH}}{{end}}</p>
146<p class="muted">HTTPS: gebruik je gebruikersnaam en een toegangstoken als wachtwoord. Branch {{.Rev}}.</p>
147{{if not .Commits}}<p class="panel">Nog geen commits.</p>{{end}}
148<ul class="clean">
149 {{range .Entries}}<li>{{if eq .Type "tree"}}<a href="/{{$.Repo.FullPath}}/-/tree/{{.Path}}?rev={{$.Rev}}">{{.Name}}/</a>{{else}}<a href="/{{$.Repo.FullPath}}/-/blob/{{.Path}}?rev={{$.Rev}}">{{.Name}}</a>{{end}}</li>{{end}}
150</ul>
151<h2>Recente commits</h2>
152<ul class="clean">
153 {{range .Commits}}<li><a href="/{{$.Repo.FullPath}}/-/commit/{{.SHA}}">{{.Short}}</a> {{.Subject}} <span class="muted">{{.Author}} · {{.Date}}</span></li>{{end}}
154</ul>
155{{template "layout-end" .}}
156{{end}}
157
158{{define "tree"}}
159{{template "layout-start" .}}
160<h1>{{.Repo.Name}}</h1>
161{{template "repotabs" .}}
162<p class="muted">{{.TreePath}}</p>
163<ul class="clean">
164 {{range .Entries}}<li>{{if eq .Type "tree"}}<a href="/{{$.Repo.FullPath}}/-/tree/{{.Path}}?rev={{$.Rev}}">{{.Name}}/</a>{{else}}<a href="/{{$.Repo.FullPath}}/-/blob/{{.Path}}?rev={{$.Rev}}">{{.Name}}</a>{{end}}</li>{{end}}
165</ul>
166{{template "layout-end" .}}
167{{end}}
168
169{{define "blob"}}
170{{template "layout-start" .}}
171<h1>{{.BlobPath}}</h1>
172{{template "repotabs" .}}
173{{if .Binary}}<p>Binair bestand, niet getoond.</p>{{else}}<pre>{{.Blob}}</pre>{{end}}
174{{template "layout-end" .}}
175{{end}}
176
177{{define "commits"}}
178{{template "layout-start" .}}
179<h1>Commits</h1>
180{{template "repotabs" .}}
181<ul class="clean">
182 {{range .Commits}}<li><a href="/{{$.Repo.FullPath}}/-/commit/{{.SHA}}">{{.Short}}</a> {{.Subject}} <span class="muted">{{.Author}} · {{.Date}}</span></li>{{else}}<li class="muted">Nog geen commits.</li>{{end}}
183</ul>
184{{template "layout-end" .}}
185{{end}}
186
187{{define "commit"}}
188{{template "layout-start" .}}
189<h1>{{.Commit.Subject}}</h1>
190{{template "repotabs" .}}
191<p class="muted">{{.Commit.SHA}} · {{.Commit.Author}} · {{.Commit.Date}}</p>
192{{if .Commit.Body}}<pre>{{.Commit.Body}}</pre>{{end}}
193{{template "layout-end" .}}
194{{end}}
195
196{{define "branches"}}
197{{template "layout-start" .}}
198<h1>Branches</h1>
199{{template "repotabs" .}}
200<ul class="clean">
201 {{range .Branches}}<li><a href="/{{$.Repo.FullPath}}?rev={{.Name}}">{{.Name}}</a> {{if .Protected}}<span class="pill">beschermd</span>{{end}}</li>{{else}}<li class="muted">Nog geen branches.</li>{{end}}
202</ul>
203{{template "layout-end" .}}
204{{end}}
internal/sshd/parse_test.go added +21 −0
@@ -0,0 +1,21 @@
1 package sshd
2
3 import "testing"
4
5 func TestParseGitCommand(t *testing.T) {
6 svc, repo, err := parseCommand("git-upload-pack 'tim/bluegit.git'")
7 if err != nil || svc != "upload-pack" || repo != "tim/bluegit.git" {
8 t.Fatalf("%s %s %v", svc, repo, err)
9 }
10 svc, repo, err = parseCommand(`git-receive-pack "/groep/site.git"`)
11 if err != nil || svc != "receive-pack" || repo != "groep/site.git" {
12 t.Fatalf("%s %s %v", svc, repo, err)
13 }
14 owner, name, ok := splitRepo("/tim/bluegit.git")
15 if !ok || owner != "tim" || name != "bluegit" {
16 t.Fatalf("%s %s %v", owner, name, ok)
17 }
18 if _, _, err := parseCommand("ls"); err == nil {
19 t.Fatal("shell hoort geweigerd")
20 }
21 }
@@ -0,0 +1,21 @@
1package sshd
2
3import "testing"
4
5func TestParseGitCommand(t *testing.T) {
6 svc, repo, err := parseCommand("git-upload-pack 'tim/bluegit.git'")
7 if err != nil || svc != "upload-pack" || repo != "tim/bluegit.git" {
8 t.Fatalf("%s %s %v", svc, repo, err)
9 }
10 svc, repo, err = parseCommand(`git-receive-pack "/groep/site.git"`)
11 if err != nil || svc != "receive-pack" || repo != "groep/site.git" {
12 t.Fatalf("%s %s %v", svc, repo, err)
13 }
14 owner, name, ok := splitRepo("/tim/bluegit.git")
15 if !ok || owner != "tim" || name != "bluegit" {
16 t.Fatalf("%s %s %v", owner, name, ok)
17 }
18 if _, _, err := parseCommand("ls"); err == nil {
19 t.Fatal("shell hoort geweigerd")
20 }
21}
internal/sshd/server.go added +292 −0
@@ -0,0 +1,292 @@
1 // Package sshd biedt git-upload-pack en git-receive-pack over SSH.
2 // Aanmelden gebeurt met een publieke sleutel die de gebruiker in BlueGit
3 // heeft gezet. Er is geen wachtwoord.
4 package sshd
5
6 import (
7 "bytes"
8 "context"
9 "crypto/ed25519"
10 "crypto/rand"
11 "encoding/pem"
12 "errors"
13 "fmt"
14 "log/slog"
15 "net"
16 "os"
17 "os/exec"
18 "path/filepath"
19 "strconv"
20 "strings"
21 "sync"
22
23 "gitlab.com/Timfa/bluegit/internal/gitrepo"
24 "gitlab.com/Timfa/bluegit/internal/store"
25 "golang.org/x/crypto/ssh"
26 )
27
28 // PushFunc krijgt het verschil in refs na een geslaagde push.
29 type PushFunc func(repo store.Repo, user store.User, before, after map[string]string)
30
31 // Server is de git-SSH-listener.
32 type Server struct {
33 Listen string
34 Store *store.Store
35 GitBin string
36 Storage string
37 HostKey string
38 Log *slog.Logger
39 OnPush PushFunc
40 mu sync.RWMutex
41 }
42
43 // SetStorage wijzigt de map met repositories. De hostkey blijft apart.
44 func (s *Server) SetStorage(path string) {
45 s.mu.Lock()
46 s.Storage = path
47 s.mu.Unlock()
48 }
49
50 func (s *Server) storage() string {
51 s.mu.RLock()
52 defer s.mu.RUnlock()
53 return s.Storage
54 }
55
56 // Run luistert tot ctx afloopt.
57 func (s *Server) Run(ctx context.Context) error {
58 signer, err := loadOrCreateHostKey(s.HostKey)
59 if err != nil {
60 return err
61 }
62 cfg := &ssh.ServerConfig{PublicKeyCallback: s.authorize}
63 cfg.AddHostKey(signer)
64 ln, err := net.Listen("tcp", s.Listen)
65 if err != nil {
66 return err
67 }
68 go func() {
69 <-ctx.Done()
70 _ = ln.Close()
71 }()
72 for {
73 conn, err := ln.Accept()
74 if err != nil {
75 if ctx.Err() != nil {
76 return nil
77 }
78 s.Log.Error("ssh accept", "err", err)
79 continue
80 }
81 go s.handle(conn, cfg)
82 }
83 }
84
85 func (s *Server) authorize(meta ssh.ConnMetadata, key ssh.PublicKey) (*ssh.Permissions, error) {
86 fp := ssh.FingerprintSHA256(key)
87 rec, err := s.Store.SSHKeyByFingerprint(context.Background(), fp)
88 if err != nil {
89 return nil, fmt.Errorf("onbekende sleutel")
90 }
91 stored, _, _, _, err := ssh.ParseAuthorizedKey([]byte(rec.PublicKey))
92 if err != nil || !bytes.Equal(stored.Marshal(), key.Marshal()) {
93 return nil, fmt.Errorf("onbekende sleutel")
94 }
95 return &ssh.Permissions{Extensions: map[string]string{"user-id": strconv.FormatInt(rec.UserID, 10)}}, nil
96 }
97
98 func (s *Server) handle(conn net.Conn, cfg *ssh.ServerConfig) {
99 defer conn.Close()
100 sc, chans, reqs, err := ssh.NewServerConn(conn, cfg)
101 if err != nil {
102 return
103 }
104 defer sc.Close()
105 go ssh.DiscardRequests(reqs)
106 userID, _ := strconv.ParseInt(sc.Permissions.Extensions["user-id"], 10, 64)
107 user, err := s.Store.UserByID(context.Background(), userID)
108 if err != nil {
109 return
110 }
111 for ch := range chans {
112 if ch.ChannelType() != "session" {
113 _ = ch.Reject(ssh.UnknownChannelType, "alleen git")
114 continue
115 }
116 channel, requests, err := ch.Accept()
117 if err != nil {
118 continue
119 }
120 go s.session(channel, requests, user)
121 }
122 }
123
124 func (s *Server) session(channel ssh.Channel, requests <-chan *ssh.Request, user store.User) {
125 defer channel.Close()
126 for req := range requests {
127 switch req.Type {
128 case "env", "pty-req":
129 _ = req.Reply(false, nil)
130 case "exec":
131 var payload struct{ Command string }
132 if err := ssh.Unmarshal(req.Payload, &payload); err != nil {
133 _ = req.Reply(false, nil)
134 return
135 }
136 _ = req.Reply(true, nil)
137 code := s.execGit(channel, user, payload.Command)
138 _, _ = channel.SendRequest("exit-status", false, ssh.Marshal(struct{ Status uint32 }{uint32(code)}))
139 return
140 default:
141 _ = req.Reply(false, nil)
142 }
143 }
144 }
145
146 func (s *Server) execGit(channel ssh.Channel, user store.User, command string) int {
147 if s.storage() == "" {
148 fmt.Fprintln(channel.Stderr(), "Opslag is nog niet ingesteld. De beheerder kiest een pad in de webinterface.")
149 return 1
150 }
151 service, repoPath, err := parseCommand(command)
152 if err != nil {
153 fmt.Fprintln(channel.Stderr(), err.Error())
154 return 1
155 }
156 owner, name, ok := splitRepo(repoPath)
157 if !ok {
158 fmt.Fprintln(channel.Stderr(), "ongeldig repositorypad")
159 return 1
160 }
161 repo, err := s.Store.RepoByPath(context.Background(), owner, name)
162 if err != nil {
163 fmt.Fprintln(channel.Stderr(), "repository niet gevonden")
164 return 1
165 }
166 role, err := s.Store.EffectiveRole(context.Background(), user.ID, repo.ID)
167 if err != nil {
168 fmt.Fprintln(channel.Stderr(), "rechten niet te bepalen")
169 return 1
170 }
171 write := service == "receive-pack"
172 if write && !role.CanWriteCode() {
173 fmt.Fprintln(channel.Stderr(), "geen schrijfrechten")
174 return 1
175 }
176 if !write && !role.CanRead() && repo.Visibility != "public" {
177 fmt.Fprintln(channel.Stderr(), "geen leesrechten")
178 return 1
179 }
180 dir := gitrepo.Dir(s.storage(), repo.OwnerPath, repo.Name)
181 var before map[string]string
182 if write {
183 before, _ = gitrepo.Refs(context.Background(), s.GitBin, dir)
184 }
185 gitCmd := "upload-pack"
186 if write {
187 gitCmd = "receive-pack"
188 }
189 cmd := exec.Command(s.GitBin, gitCmd, dir)
190 cmd.Stdin = channel
191 cmd.Stdout = channel
192 cmd.Stderr = channel.Stderr()
193 if write {
194 patterns, _ := s.Store.ProtectedPatterns(context.Background(), repo.ID)
195 cmd.Env = append(os.Environ(), gitrepo.PushEnv(role, patterns)...)
196 }
197 runErr := cmd.Run()
198 if write && runErr == nil && s.OnPush != nil {
199 after, err := gitrepo.Refs(context.Background(), s.GitBin, dir)
200 if err == nil {
201 s.OnPush(repo, user, before, after)
202 }
203 }
204 if runErr != nil {
205 return exitCode(runErr)
206 }
207 return 0
208 }
209
210 func parseCommand(command string) (service, repo string, err error) {
211 fields := splitCmd(command)
212 if len(fields) != 2 {
213 return "", "", fmt.Errorf("alleen git-upload-pack en git-receive-pack")
214 }
215 switch fields[0] {
216 case "git-upload-pack", "upload-pack":
217 service = "upload-pack"
218 case "git-receive-pack", "receive-pack":
219 service = "receive-pack"
220 default:
221 return "", "", fmt.Errorf("alleen git-upload-pack en git-receive-pack")
222 }
223 return service, strings.TrimPrefix(fields[1], "/"), nil
224 }
225
226 func splitCmd(s string) []string {
227 var out []string
228 var b strings.Builder
229 quote := byte(0)
230 for i := 0; i < len(s); i++ {
231 c := s[i]
232 switch {
233 case quote != 0 && c == quote:
234 quote = 0
235 case quote != 0:
236 b.WriteByte(c)
237 case c == '\'' || c == '"':
238 quote = c
239 case c == ' ' || c == '\t':
240 if b.Len() > 0 {
241 out = append(out, b.String())
242 b.Reset()
243 }
244 default:
245 b.WriteByte(c)
246 }
247 }
248 if b.Len() > 0 {
249 out = append(out, b.String())
250 }
251 return out
252 }
253
254 func splitRepo(p string) (owner, name string, ok bool) {
255 p = strings.TrimPrefix(strings.TrimSpace(p), "/")
256 p = strings.TrimSuffix(p, ".git")
257 owner, name, ok = strings.Cut(p, "/")
258 if !ok || owner == "" || name == "" || strings.Contains(owner, "/") || strings.Contains(name, "/") || strings.Contains(p, "..") {
259 return "", "", false
260 }
261 return owner, name, true
262 }
263
264 func exitCode(err error) int {
265 var ee *exec.ExitError
266 if errors.As(err, &ee) {
267 return ee.ExitCode()
268 }
269 return 1
270 }
271
272 func loadOrCreateHostKey(path string) (ssh.Signer, error) {
273 if b, err := os.ReadFile(path); err == nil {
274 return ssh.ParsePrivateKey(b)
275 }
276 if err := os.MkdirAll(filepath.Dir(path), 0o700); err != nil {
277 return nil, err
278 }
279 _, priv, err := ed25519.GenerateKey(rand.Reader)
280 if err != nil {
281 return nil, err
282 }
283 block, err := ssh.MarshalPrivateKey(priv, "bluegit")
284 if err != nil {
285 return nil, err
286 }
287 pemBytes := pem.EncodeToMemory(block)
288 if err := os.WriteFile(path, pemBytes, 0o600); err != nil {
289 return nil, err
290 }
291 return ssh.ParsePrivateKey(pemBytes)
292 }
@@ -0,0 +1,292 @@
1// Package sshd biedt git-upload-pack en git-receive-pack over SSH.
2// Aanmelden gebeurt met een publieke sleutel die de gebruiker in BlueGit
3// heeft gezet. Er is geen wachtwoord.
4package sshd
5
6import (
7 "bytes"
8 "context"
9 "crypto/ed25519"
10 "crypto/rand"
11 "encoding/pem"
12 "errors"
13 "fmt"
14 "log/slog"
15 "net"
16 "os"
17 "os/exec"
18 "path/filepath"
19 "strconv"
20 "strings"
21 "sync"
22
23 "gitlab.com/Timfa/bluegit/internal/gitrepo"
24 "gitlab.com/Timfa/bluegit/internal/store"
25 "golang.org/x/crypto/ssh"
26)
27
28// PushFunc krijgt het verschil in refs na een geslaagde push.
29type PushFunc func(repo store.Repo, user store.User, before, after map[string]string)
30
31// Server is de git-SSH-listener.
32type Server struct {
33 Listen string
34 Store *store.Store
35 GitBin string
36 Storage string
37 HostKey string
38 Log *slog.Logger
39 OnPush PushFunc
40 mu sync.RWMutex
41}
42
43// SetStorage wijzigt de map met repositories. De hostkey blijft apart.
44func (s *Server) SetStorage(path string) {
45 s.mu.Lock()
46 s.Storage = path
47 s.mu.Unlock()
48}
49
50func (s *Server) storage() string {
51 s.mu.RLock()
52 defer s.mu.RUnlock()
53 return s.Storage
54}
55
56// Run luistert tot ctx afloopt.
57func (s *Server) Run(ctx context.Context) error {
58 signer, err := loadOrCreateHostKey(s.HostKey)
59 if err != nil {
60 return err
61 }
62 cfg := &ssh.ServerConfig{PublicKeyCallback: s.authorize}
63 cfg.AddHostKey(signer)
64 ln, err := net.Listen("tcp", s.Listen)
65 if err != nil {
66 return err
67 }
68 go func() {
69 <-ctx.Done()
70 _ = ln.Close()
71 }()
72 for {
73 conn, err := ln.Accept()
74 if err != nil {
75 if ctx.Err() != nil {
76 return nil
77 }
78 s.Log.Error("ssh accept", "err", err)
79 continue
80 }
81 go s.handle(conn, cfg)
82 }
83}
84
85func (s *Server) authorize(meta ssh.ConnMetadata, key ssh.PublicKey) (*ssh.Permissions, error) {
86 fp := ssh.FingerprintSHA256(key)
87 rec, err := s.Store.SSHKeyByFingerprint(context.Background(), fp)
88 if err != nil {
89 return nil, fmt.Errorf("onbekende sleutel")
90 }
91 stored, _, _, _, err := ssh.ParseAuthorizedKey([]byte(rec.PublicKey))
92 if err != nil || !bytes.Equal(stored.Marshal(), key.Marshal()) {
93 return nil, fmt.Errorf("onbekende sleutel")
94 }
95 return &ssh.Permissions{Extensions: map[string]string{"user-id": strconv.FormatInt(rec.UserID, 10)}}, nil
96}
97
98func (s *Server) handle(conn net.Conn, cfg *ssh.ServerConfig) {
99 defer conn.Close()
100 sc, chans, reqs, err := ssh.NewServerConn(conn, cfg)
101 if err != nil {
102 return
103 }
104 defer sc.Close()
105 go ssh.DiscardRequests(reqs)
106 userID, _ := strconv.ParseInt(sc.Permissions.Extensions["user-id"], 10, 64)
107 user, err := s.Store.UserByID(context.Background(), userID)
108 if err != nil {
109 return
110 }
111 for ch := range chans {
112 if ch.ChannelType() != "session" {
113 _ = ch.Reject(ssh.UnknownChannelType, "alleen git")
114 continue
115 }
116 channel, requests, err := ch.Accept()
117 if err != nil {
118 continue
119 }
120 go s.session(channel, requests, user)
121 }
122}
123
124func (s *Server) session(channel ssh.Channel, requests <-chan *ssh.Request, user store.User) {
125 defer channel.Close()
126 for req := range requests {
127 switch req.Type {
128 case "env", "pty-req":
129 _ = req.Reply(false, nil)
130 case "exec":
131 var payload struct{ Command string }
132 if err := ssh.Unmarshal(req.Payload, &payload); err != nil {
133 _ = req.Reply(false, nil)
134 return
135 }
136 _ = req.Reply(true, nil)
137 code := s.execGit(channel, user, payload.Command)
138 _, _ = channel.SendRequest("exit-status", false, ssh.Marshal(struct{ Status uint32 }{uint32(code)}))
139 return
140 default:
141 _ = req.Reply(false, nil)
142 }
143 }
144}
145
146func (s *Server) execGit(channel ssh.Channel, user store.User, command string) int {
147 if s.storage() == "" {
148 fmt.Fprintln(channel.Stderr(), "Opslag is nog niet ingesteld. De beheerder kiest een pad in de webinterface.")
149 return 1
150 }
151 service, repoPath, err := parseCommand(command)
152 if err != nil {
153 fmt.Fprintln(channel.Stderr(), err.Error())
154 return 1
155 }
156 owner, name, ok := splitRepo(repoPath)
157 if !ok {
158 fmt.Fprintln(channel.Stderr(), "ongeldig repositorypad")
159 return 1
160 }
161 repo, err := s.Store.RepoByPath(context.Background(), owner, name)
162 if err != nil {
163 fmt.Fprintln(channel.Stderr(), "repository niet gevonden")
164 return 1
165 }
166 role, err := s.Store.EffectiveRole(context.Background(), user.ID, repo.ID)
167 if err != nil {
168 fmt.Fprintln(channel.Stderr(), "rechten niet te bepalen")
169 return 1
170 }
171 write := service == "receive-pack"
172 if write && !role.CanWriteCode() {
173 fmt.Fprintln(channel.Stderr(), "geen schrijfrechten")
174 return 1
175 }
176 if !write && !role.CanRead() && repo.Visibility != "public" {
177 fmt.Fprintln(channel.Stderr(), "geen leesrechten")
178 return 1
179 }
180 dir := gitrepo.Dir(s.storage(), repo.OwnerPath, repo.Name)
181 var before map[string]string
182 if write {
183 before, _ = gitrepo.Refs(context.Background(), s.GitBin, dir)
184 }
185 gitCmd := "upload-pack"
186 if write {
187 gitCmd = "receive-pack"
188 }
189 cmd := exec.Command(s.GitBin, gitCmd, dir)
190 cmd.Stdin = channel
191 cmd.Stdout = channel
192 cmd.Stderr = channel.Stderr()
193 if write {
194 patterns, _ := s.Store.ProtectedPatterns(context.Background(), repo.ID)
195 cmd.Env = append(os.Environ(), gitrepo.PushEnv(role, patterns)...)
196 }
197 runErr := cmd.Run()
198 if write && runErr == nil && s.OnPush != nil {
199 after, err := gitrepo.Refs(context.Background(), s.GitBin, dir)
200 if err == nil {
201 s.OnPush(repo, user, before, after)
202 }
203 }
204 if runErr != nil {
205 return exitCode(runErr)
206 }
207 return 0
208}
209
210func parseCommand(command string) (service, repo string, err error) {
211 fields := splitCmd(command)
212 if len(fields) != 2 {
213 return "", "", fmt.Errorf("alleen git-upload-pack en git-receive-pack")
214 }
215 switch fields[0] {
216 case "git-upload-pack", "upload-pack":
217 service = "upload-pack"
218 case "git-receive-pack", "receive-pack":
219 service = "receive-pack"
220 default:
221 return "", "", fmt.Errorf("alleen git-upload-pack en git-receive-pack")
222 }
223 return service, strings.TrimPrefix(fields[1], "/"), nil
224}
225
226func splitCmd(s string) []string {
227 var out []string
228 var b strings.Builder
229 quote := byte(0)
230 for i := 0; i < len(s); i++ {
231 c := s[i]
232 switch {
233 case quote != 0 && c == quote:
234 quote = 0
235 case quote != 0:
236 b.WriteByte(c)
237 case c == '\'' || c == '"':
238 quote = c
239 case c == ' ' || c == '\t':
240 if b.Len() > 0 {
241 out = append(out, b.String())
242 b.Reset()
243 }
244 default:
245 b.WriteByte(c)
246 }
247 }
248 if b.Len() > 0 {
249 out = append(out, b.String())
250 }
251 return out
252}
253
254func splitRepo(p string) (owner, name string, ok bool) {
255 p = strings.TrimPrefix(strings.TrimSpace(p), "/")
256 p = strings.TrimSuffix(p, ".git")
257 owner, name, ok = strings.Cut(p, "/")
258 if !ok || owner == "" || name == "" || strings.Contains(owner, "/") || strings.Contains(name, "/") || strings.Contains(p, "..") {
259 return "", "", false
260 }
261 return owner, name, true
262}
263
264func exitCode(err error) int {
265 var ee *exec.ExitError
266 if errors.As(err, &ee) {
267 return ee.ExitCode()
268 }
269 return 1
270}
271
272func loadOrCreateHostKey(path string) (ssh.Signer, error) {
273 if b, err := os.ReadFile(path); err == nil {
274 return ssh.ParsePrivateKey(b)
275 }
276 if err := os.MkdirAll(filepath.Dir(path), 0o700); err != nil {
277 return nil, err
278 }
279 _, priv, err := ed25519.GenerateKey(rand.Reader)
280 if err != nil {
281 return nil, err
282 }
283 block, err := ssh.MarshalPrivateKey(priv, "bluegit")
284 if err != nil {
285 return nil, err
286 }
287 pemBytes := pem.EncodeToMemory(block)
288 if err := os.WriteFile(path, pemBytes, 0o600); err != nil {
289 return nil, err
290 }
291 return ssh.ParsePrivateKey(pemBytes)
292}
internal/ssrf/ssrf.go added +241 −0
@@ -0,0 +1,241 @@
1 // Package ssrf keurt webhook-bestemmingen.
2 // Privénetwerken zijn geblokkeerd. Een naam die naar een publiek IP
3 // wijst mag wel, ook als een router dat verkeer daarna terug naar huis
4 // stuurt. Het IP wordt bij het verbinden vastgezet, zodat een tweede
5 // DNS-antwoord niet alsnog een privéadres kan worden.
6 package ssrf
7
8 import (
9 "context"
10 "fmt"
11 "net"
12 "net/http"
13 "net/url"
14 "strings"
15 "time"
16 )
17
18 // MaxRedirects is het aantal hops dat een webhook nog volgt.
19 const MaxRedirects = 3
20
21 var (
22 v4Blocked []*net.IPNet
23 v6Blocked []*net.IPNet
24 )
25
26 func init() {
27 // RFC1918, loopback, link-local (daar zit 169.254.169.254 bij),
28 // CGNAT, unspecified, multicast en gereserveerd.
29 v4Blocked = mustCIDR(
30 "0.0.0.0/8",
31 "10.0.0.0/8",
32 "100.64.0.0/10",
33 "127.0.0.0/8",
34 "169.254.0.0/16",
35 "172.16.0.0/12",
36 "192.168.0.0/16",
37 "224.0.0.0/4",
38 "240.0.0.0/4",
39 )
40 // Loopback, ULA, link-local, het oude site-local, multicast.
41 v6Blocked = mustCIDR(
42 "::1/128",
43 "fc00::/7",
44 "fe80::/10",
45 "fec0::/10",
46 "ff00::/8",
47 )
48 }
49
50 func mustCIDR(cidrs ...string) []*net.IPNet {
51 var out []*net.IPNet
52 for _, c := range cidrs {
53 _, n, err := net.ParseCIDR(c)
54 if err != nil {
55 panic(err)
56 }
57 out = append(out, n)
58 }
59 return out
60 }
61
62 // Private meldt of ip geen publiek unicast-adres is.
63 // IPv4-mapped adressen, 6to4 en NAT64 (64:ff9b::/96) worden beoordeeld
64 // op het ingebedde IPv4-adres.
65 func Private(ip net.IP) bool {
66 if ip == nil {
67 return true
68 }
69 if v4 := embeddedV4(ip); v4 != nil {
70 return privateV4(v4)
71 }
72 if v4 := ip.To4(); v4 != nil {
73 return privateV4(v4)
74 }
75 v6 := ip.To16()
76 if v6 == nil {
77 return true
78 }
79 if v6.Equal(net.IPv6unspecified) {
80 return true
81 }
82 for _, n := range v6Blocked {
83 if n.Contains(v6) {
84 return true
85 }
86 }
87 return false
88 }
89
90 func privateV4(ip net.IP) bool {
91 ip = ip.To4()
92 if ip == nil {
93 return true
94 }
95 for _, n := range v4Blocked {
96 if n.Contains(ip) {
97 return true
98 }
99 }
100 return false
101 }
102
103 // embeddedV4 haalt een IPv4-adres uit 6to4 (2002::/16) of NAT64 (64:ff9b::/96).
104 func embeddedV4(ip net.IP) net.IP {
105 v6 := ip.To16()
106 if v6 == nil || ip.To4() != nil {
107 return nil
108 }
109 if v6[0] == 0x20 && v6[1] == 0x02 {
110 return net.IPv4(v6[2], v6[3], v6[4], v6[5]).To4()
111 }
112 if v6[0] == 0x00 && v6[1] == 0x64 && v6[2] == 0xff && v6[3] == 0x9b && allZero(v6[4:12]) {
113 return net.IPv4(v6[12], v6[13], v6[14], v6[15]).To4()
114 }
115 return nil
116 }
117
118 func allZero(b []byte) bool {
119 for _, c := range b {
120 if c != 0 {
121 return false
122 }
123 }
124 return true
125 }
126
127 // Lookup zoekt de adressen van een hostnaam. Tests vullen een eigen functie in.
128 type Lookup func(ctx context.Context, host string) ([]net.IP, error)
129
130 func defaultLookup(ctx context.Context, host string) ([]net.IP, error) {
131 addrs, err := net.DefaultResolver.LookupIPAddr(ctx, host)
132 if err != nil {
133 return nil, err
134 }
135 out := make([]net.IP, 0, len(addrs))
136 for _, a := range addrs {
137 out = append(out, a.IP)
138 }
139 return out, nil
140 }
141
142 // Pin kiest het IP waarmee verbonden wordt.
143 // Een letterlijk privéadres wordt geweigerd zonder DNS. Een naam waarvan
144 // minstens één adres geblokkeerd is, wordt helemaal geweigerd: anders kan
145 // het tweede antwoord alsnog naar het lokale net wijzen.
146 func Pin(ctx context.Context, host string, lookup Lookup) (net.IP, error) {
147 host = strings.TrimSuffix(strings.TrimSpace(host), ".")
148 if host == "" {
149 return nil, fmt.Errorf("webhook-host ontbreekt")
150 }
151 if ip := net.ParseIP(host); ip != nil {
152 if Private(ip) {
153 return nil, fmt.Errorf("%s ligt in een geblokkeerd bereik", ip)
154 }
155 return ip, nil
156 }
157 if lookup == nil {
158 lookup = defaultLookup
159 }
160 ips, err := lookup(ctx, host)
161 if err != nil {
162 return nil, fmt.Errorf("dns voor %s: %w", host, err)
163 }
164 if len(ips) == 0 {
165 return nil, fmt.Errorf("geen adres voor %s", host)
166 }
167 for _, ip := range ips {
168 if Private(ip) {
169 return nil, fmt.Errorf("%s wijst naar %s in een geblokkeerd bereik", host, ip)
170 }
171 }
172 return ips[0], nil
173 }
174
175 // ValidateURL keurt het schema, een userinfo en een letterlijk privéadres af.
176 func ValidateURL(u *url.URL) error {
177 if u == nil || u.Hostname() == "" || u.User != nil {
178 return fmt.Errorf("webhook-URL is ongeldig")
179 }
180 if u.Scheme != "http" && u.Scheme != "https" {
181 return fmt.Errorf("webhook-URL moet http of https zijn")
182 }
183 if ip := net.ParseIP(u.Hostname()); ip != nil && Private(ip) {
184 return fmt.Errorf("%s ligt in een geblokkeerd bereik", ip)
185 }
186 return nil
187 }
188
189 func checkRedirect(req *http.Request, via []*http.Request) error {
190 if len(via) >= MaxRedirects {
191 return fmt.Errorf("te veel redirects")
192 }
193 if err := ValidateURL(req.URL); err != nil {
194 return err
195 }
196 if len(via) == 0 || via[0].URL == nil || sameHost(via[0].URL, req.URL) {
197 return nil
198 }
199 if req.Response != nil && (req.Response.StatusCode == http.StatusTemporaryRedirect || req.Response.StatusCode == http.StatusPermanentRedirect) {
200 return fmt.Errorf("redirect naar een andere host met de oorspronkelijke body is geweigerd")
201 }
202 for k := range req.Header {
203 if strings.EqualFold(k, "Content-Type") || strings.EqualFold(k, "User-Agent") {
204 continue
205 }
206 req.Header.Del(k)
207 }
208 return nil
209 }
210
211 func sameHost(a, b *url.URL) bool {
212 if a == nil || b == nil {
213 return false
214 }
215 return strings.EqualFold(a.Hostname(), b.Hostname())
216 }
217
218 // NewClient belt alleen publieke IP's en zet het gekozen adres vast.
219 // Omgevingsproxies worden niet gebruikt.
220 func NewClient(timeout time.Duration) *http.Client {
221 dialer := &net.Dialer{Timeout: 5 * time.Second, KeepAlive: 30 * time.Second}
222 transport := &http.Transport{
223 DialContext: func(ctx context.Context, network, addr string) (net.Conn, error) {
224 host, port, err := net.SplitHostPort(addr)
225 if err != nil {
226 return nil, err
227 }
228 ip, err := Pin(ctx, host, nil)
229 if err != nil {
230 return nil, err
231 }
232 return dialer.DialContext(ctx, network, net.JoinHostPort(ip.String(), port))
233 },
234 TLSHandshakeTimeout: 5 * time.Second,
235 ForceAttemptHTTP2: true,
236 }
237 if timeout <= 0 {
238 timeout = 10 * time.Second
239 }
240 return &http.Client{Timeout: timeout, Transport: transport, CheckRedirect: checkRedirect}
241 }
@@ -0,0 +1,241 @@
1// Package ssrf keurt webhook-bestemmingen.
2// Privénetwerken zijn geblokkeerd. Een naam die naar een publiek IP
3// wijst mag wel, ook als een router dat verkeer daarna terug naar huis
4// stuurt. Het IP wordt bij het verbinden vastgezet, zodat een tweede
5// DNS-antwoord niet alsnog een privéadres kan worden.
6package ssrf
7
8import (
9 "context"
10 "fmt"
11 "net"
12 "net/http"
13 "net/url"
14 "strings"
15 "time"
16)
17
18// MaxRedirects is het aantal hops dat een webhook nog volgt.
19const MaxRedirects = 3
20
21var (
22 v4Blocked []*net.IPNet
23 v6Blocked []*net.IPNet
24)
25
26func init() {
27 // RFC1918, loopback, link-local (daar zit 169.254.169.254 bij),
28 // CGNAT, unspecified, multicast en gereserveerd.
29 v4Blocked = mustCIDR(
30 "0.0.0.0/8",
31 "10.0.0.0/8",
32 "100.64.0.0/10",
33 "127.0.0.0/8",
34 "169.254.0.0/16",
35 "172.16.0.0/12",
36 "192.168.0.0/16",
37 "224.0.0.0/4",
38 "240.0.0.0/4",
39 )
40 // Loopback, ULA, link-local, het oude site-local, multicast.
41 v6Blocked = mustCIDR(
42 "::1/128",
43 "fc00::/7",
44 "fe80::/10",
45 "fec0::/10",
46 "ff00::/8",
47 )
48}
49
50func mustCIDR(cidrs ...string) []*net.IPNet {
51 var out []*net.IPNet
52 for _, c := range cidrs {
53 _, n, err := net.ParseCIDR(c)
54 if err != nil {
55 panic(err)
56 }
57 out = append(out, n)
58 }
59 return out
60}
61
62// Private meldt of ip geen publiek unicast-adres is.
63// IPv4-mapped adressen, 6to4 en NAT64 (64:ff9b::/96) worden beoordeeld
64// op het ingebedde IPv4-adres.
65func Private(ip net.IP) bool {
66 if ip == nil {
67 return true
68 }
69 if v4 := embeddedV4(ip); v4 != nil {
70 return privateV4(v4)
71 }
72 if v4 := ip.To4(); v4 != nil {
73 return privateV4(v4)
74 }
75 v6 := ip.To16()
76 if v6 == nil {
77 return true
78 }
79 if v6.Equal(net.IPv6unspecified) {
80 return true
81 }
82 for _, n := range v6Blocked {
83 if n.Contains(v6) {
84 return true
85 }
86 }
87 return false
88}
89
90func privateV4(ip net.IP) bool {
91 ip = ip.To4()
92 if ip == nil {
93 return true
94 }
95 for _, n := range v4Blocked {
96 if n.Contains(ip) {
97 return true
98 }
99 }
100 return false
101}
102
103// embeddedV4 haalt een IPv4-adres uit 6to4 (2002::/16) of NAT64 (64:ff9b::/96).
104func embeddedV4(ip net.IP) net.IP {
105 v6 := ip.To16()
106 if v6 == nil || ip.To4() != nil {
107 return nil
108 }
109 if v6[0] == 0x20 && v6[1] == 0x02 {
110 return net.IPv4(v6[2], v6[3], v6[4], v6[5]).To4()
111 }
112 if v6[0] == 0x00 && v6[1] == 0x64 && v6[2] == 0xff && v6[3] == 0x9b && allZero(v6[4:12]) {
113 return net.IPv4(v6[12], v6[13], v6[14], v6[15]).To4()
114 }
115 return nil
116}
117
118func allZero(b []byte) bool {
119 for _, c := range b {
120 if c != 0 {
121 return false
122 }
123 }
124 return true
125}
126
127// Lookup zoekt de adressen van een hostnaam. Tests vullen een eigen functie in.
128type Lookup func(ctx context.Context, host string) ([]net.IP, error)
129
130func defaultLookup(ctx context.Context, host string) ([]net.IP, error) {
131 addrs, err := net.DefaultResolver.LookupIPAddr(ctx, host)
132 if err != nil {
133 return nil, err
134 }
135 out := make([]net.IP, 0, len(addrs))
136 for _, a := range addrs {
137 out = append(out, a.IP)
138 }
139 return out, nil
140}
141
142// Pin kiest het IP waarmee verbonden wordt.
143// Een letterlijk privéadres wordt geweigerd zonder DNS. Een naam waarvan
144// minstens één adres geblokkeerd is, wordt helemaal geweigerd: anders kan
145// het tweede antwoord alsnog naar het lokale net wijzen.
146func Pin(ctx context.Context, host string, lookup Lookup) (net.IP, error) {
147 host = strings.TrimSuffix(strings.TrimSpace(host), ".")
148 if host == "" {
149 return nil, fmt.Errorf("webhook-host ontbreekt")
150 }
151 if ip := net.ParseIP(host); ip != nil {
152 if Private(ip) {
153 return nil, fmt.Errorf("%s ligt in een geblokkeerd bereik", ip)
154 }
155 return ip, nil
156 }
157 if lookup == nil {
158 lookup = defaultLookup
159 }
160 ips, err := lookup(ctx, host)
161 if err != nil {
162 return nil, fmt.Errorf("dns voor %s: %w", host, err)
163 }
164 if len(ips) == 0 {
165 return nil, fmt.Errorf("geen adres voor %s", host)
166 }
167 for _, ip := range ips {
168 if Private(ip) {
169 return nil, fmt.Errorf("%s wijst naar %s in een geblokkeerd bereik", host, ip)
170 }
171 }
172 return ips[0], nil
173}
174
175// ValidateURL keurt het schema, een userinfo en een letterlijk privéadres af.
176func ValidateURL(u *url.URL) error {
177 if u == nil || u.Hostname() == "" || u.User != nil {
178 return fmt.Errorf("webhook-URL is ongeldig")
179 }
180 if u.Scheme != "http" && u.Scheme != "https" {
181 return fmt.Errorf("webhook-URL moet http of https zijn")
182 }
183 if ip := net.ParseIP(u.Hostname()); ip != nil && Private(ip) {
184 return fmt.Errorf("%s ligt in een geblokkeerd bereik", ip)
185 }
186 return nil
187}
188
189func checkRedirect(req *http.Request, via []*http.Request) error {
190 if len(via) >= MaxRedirects {
191 return fmt.Errorf("te veel redirects")
192 }
193 if err := ValidateURL(req.URL); err != nil {
194 return err
195 }
196 if len(via) == 0 || via[0].URL == nil || sameHost(via[0].URL, req.URL) {
197 return nil
198 }
199 if req.Response != nil && (req.Response.StatusCode == http.StatusTemporaryRedirect || req.Response.StatusCode == http.StatusPermanentRedirect) {
200 return fmt.Errorf("redirect naar een andere host met de oorspronkelijke body is geweigerd")
201 }
202 for k := range req.Header {
203 if strings.EqualFold(k, "Content-Type") || strings.EqualFold(k, "User-Agent") {
204 continue
205 }
206 req.Header.Del(k)
207 }
208 return nil
209}
210
211func sameHost(a, b *url.URL) bool {
212 if a == nil || b == nil {
213 return false
214 }
215 return strings.EqualFold(a.Hostname(), b.Hostname())
216}
217
218// NewClient belt alleen publieke IP's en zet het gekozen adres vast.
219// Omgevingsproxies worden niet gebruikt.
220func NewClient(timeout time.Duration) *http.Client {
221 dialer := &net.Dialer{Timeout: 5 * time.Second, KeepAlive: 30 * time.Second}
222 transport := &http.Transport{
223 DialContext: func(ctx context.Context, network, addr string) (net.Conn, error) {
224 host, port, err := net.SplitHostPort(addr)
225 if err != nil {
226 return nil, err
227 }
228 ip, err := Pin(ctx, host, nil)
229 if err != nil {
230 return nil, err
231 }
232 return dialer.DialContext(ctx, network, net.JoinHostPort(ip.String(), port))
233 },
234 TLSHandshakeTimeout: 5 * time.Second,
235 ForceAttemptHTTP2: true,
236 }
237 if timeout <= 0 {
238 timeout = 10 * time.Second
239 }
240 return &http.Client{Timeout: timeout, Transport: transport, CheckRedirect: checkRedirect}
241}
internal/ssrf/ssrf_test.go added +122 −0
@@ -0,0 +1,122 @@
1 package ssrf
2
3 import (
4 "context"
5 "net"
6 "net/http"
7 "net/url"
8 "testing"
9 )
10
11 func TestPrivateRanges(t *testing.T) {
12 blocked := []string{
13 "0.0.0.0", "10.1.2.3", "127.0.0.1", "127.255.0.1",
14 "100.64.0.1", "100.100.100.200", "100.127.255.255",
15 "169.254.1.1", "169.254.169.254", "169.254.170.2",
16 "172.16.0.1", "172.31.255.255", "192.168.1.1",
17 "224.0.0.1", "240.0.0.1", "255.255.255.255",
18 "::", "::1", "fc00::1", "fd00:ec2::254", "fd12:3456::1",
19 "fe80::1", "fec0::1", "ff02::1",
20 "::ffff:10.1.2.3", "::ffff:127.0.0.1",
21 "2002:0a00:0001::",
22 "64:ff9b::a00:1",
23 }
24 for _, s := range blocked {
25 ip := net.ParseIP(s)
26 if ip == nil {
27 t.Fatalf("ongeldig testadres %s", s)
28 }
29 if !Private(ip) {
30 t.Errorf("%s hoort geblokkeerd", s)
31 }
32 }
33 allowed := []string{
34 "1.1.1.1", "8.8.8.8", "203.0.113.5", "86.95.10.20",
35 "100.63.255.255", "172.15.255.255", "172.32.0.1", "11.0.0.1",
36 "2001:4860:4860::8888",
37 "2002:0808:0808::",
38 "64:ff9b::808:808",
39 }
40 for _, s := range allowed {
41 ip := net.ParseIP(s)
42 if ip == nil {
43 t.Fatalf("ongeldig testadres %s", s)
44 }
45 if Private(ip) {
46 t.Errorf("%s hoort publiek", s)
47 }
48 }
49 }
50
51 func TestPinLiteralAndDNS(t *testing.T) {
52 ctx := context.Background()
53 if _, err := Pin(ctx, "127.0.0.1", func(context.Context, string) ([]net.IP, error) {
54 t.Fatal("letterlijk IP hoort geen DNS te doen")
55 return nil, nil
56 }); err == nil {
57 t.Fatal("loopback hoort geweigerd")
58 }
59 if _, err := Pin(ctx, "169.254.169.254", nil); err == nil {
60 t.Fatal("metadata-adres hoort geweigerd")
61 }
62 got, err := Pin(ctx, "hooks.example", func(context.Context, string) ([]net.IP, error) {
63 return []net.IP{net.ParseIP("86.95.10.20")}, nil
64 })
65 if err != nil {
66 t.Fatal(err)
67 }
68 if !got.Equal(net.ParseIP("86.95.10.20")) {
69 t.Fatalf("vastgezet IP %s", got)
70 }
71 if _, err := Pin(ctx, "evil.example", func(context.Context, string) ([]net.IP, error) {
72 return []net.IP{net.ParseIP("1.1.1.1"), net.ParseIP("10.0.0.1")}, nil
73 }); err == nil {
74 t.Fatal("een gemengd DNS-antwoord hoort geweigerd")
75 }
76 }
77
78 func TestRedirectChecksEachHop(t *testing.T) {
79 literal, err := url.Parse("http://192.168.1.9/hook")
80 if err != nil {
81 t.Fatal(err)
82 }
83 if err := checkRedirect(&http.Request{URL: literal}, nil); err == nil {
84 t.Fatal("redirect naar een privé-IP hoort geweigerd")
85 }
86 next, err := url.Parse("https://hooks.example/hook")
87 if err != nil {
88 t.Fatal(err)
89 }
90 via := make([]*http.Request, MaxRedirects)
91 for i := range via {
92 via[i] = &http.Request{URL: next}
93 }
94 if err := checkRedirect(&http.Request{URL: next}, via); err == nil {
95 t.Fatal("te veel redirects")
96 }
97
98 origin, err := url.Parse("https://discord.example/api")
99 if err != nil {
100 t.Fatal(err)
101 }
102 other, err := url.Parse("https://other.example/land")
103 if err != nil {
104 t.Fatal(err)
105 }
106 req := &http.Request{URL: other, Header: http.Header{}, Response: &http.Response{StatusCode: http.StatusFound}}
107 req.Header.Set("Authorization", "Bearer geheim")
108 req.Header.Set("Content-Type", "application/json")
109 if err := checkRedirect(req, []*http.Request{{URL: origin}}); err != nil {
110 t.Fatal(err)
111 }
112 if req.Header.Get("Authorization") != "" {
113 t.Fatal("header naar een andere host bleef staan")
114 }
115 if req.Header.Get("Content-Type") != "application/json" {
116 t.Fatal("content-type hoort te blijven")
117 }
118 keep := &http.Request{URL: other, Header: http.Header{}, Response: &http.Response{StatusCode: http.StatusTemporaryRedirect}}
119 if err := checkRedirect(keep, []*http.Request{{URL: origin}}); err == nil {
120 t.Fatal("307 naar een andere host hoort geweigerd")
121 }
122 }
@@ -0,0 +1,122 @@
1package ssrf
2
3import (
4 "context"
5 "net"
6 "net/http"
7 "net/url"
8 "testing"
9)
10
11func TestPrivateRanges(t *testing.T) {
12 blocked := []string{
13 "0.0.0.0", "10.1.2.3", "127.0.0.1", "127.255.0.1",
14 "100.64.0.1", "100.100.100.200", "100.127.255.255",
15 "169.254.1.1", "169.254.169.254", "169.254.170.2",
16 "172.16.0.1", "172.31.255.255", "192.168.1.1",
17 "224.0.0.1", "240.0.0.1", "255.255.255.255",
18 "::", "::1", "fc00::1", "fd00:ec2::254", "fd12:3456::1",
19 "fe80::1", "fec0::1", "ff02::1",
20 "::ffff:10.1.2.3", "::ffff:127.0.0.1",
21 "2002:0a00:0001::",
22 "64:ff9b::a00:1",
23 }
24 for _, s := range blocked {
25 ip := net.ParseIP(s)
26 if ip == nil {
27 t.Fatalf("ongeldig testadres %s", s)
28 }
29 if !Private(ip) {
30 t.Errorf("%s hoort geblokkeerd", s)
31 }
32 }
33 allowed := []string{
34 "1.1.1.1", "8.8.8.8", "203.0.113.5", "86.95.10.20",
35 "100.63.255.255", "172.15.255.255", "172.32.0.1", "11.0.0.1",
36 "2001:4860:4860::8888",
37 "2002:0808:0808::",
38 "64:ff9b::808:808",
39 }
40 for _, s := range allowed {
41 ip := net.ParseIP(s)
42 if ip == nil {
43 t.Fatalf("ongeldig testadres %s", s)
44 }
45 if Private(ip) {
46 t.Errorf("%s hoort publiek", s)
47 }
48 }
49}
50
51func TestPinLiteralAndDNS(t *testing.T) {
52 ctx := context.Background()
53 if _, err := Pin(ctx, "127.0.0.1", func(context.Context, string) ([]net.IP, error) {
54 t.Fatal("letterlijk IP hoort geen DNS te doen")
55 return nil, nil
56 }); err == nil {
57 t.Fatal("loopback hoort geweigerd")
58 }
59 if _, err := Pin(ctx, "169.254.169.254", nil); err == nil {
60 t.Fatal("metadata-adres hoort geweigerd")
61 }
62 got, err := Pin(ctx, "hooks.example", func(context.Context, string) ([]net.IP, error) {
63 return []net.IP{net.ParseIP("86.95.10.20")}, nil
64 })
65 if err != nil {
66 t.Fatal(err)
67 }
68 if !got.Equal(net.ParseIP("86.95.10.20")) {
69 t.Fatalf("vastgezet IP %s", got)
70 }
71 if _, err := Pin(ctx, "evil.example", func(context.Context, string) ([]net.IP, error) {
72 return []net.IP{net.ParseIP("1.1.1.1"), net.ParseIP("10.0.0.1")}, nil
73 }); err == nil {
74 t.Fatal("een gemengd DNS-antwoord hoort geweigerd")
75 }
76}
77
78func TestRedirectChecksEachHop(t *testing.T) {
79 literal, err := url.Parse("http://192.168.1.9/hook")
80 if err != nil {
81 t.Fatal(err)
82 }
83 if err := checkRedirect(&http.Request{URL: literal}, nil); err == nil {
84 t.Fatal("redirect naar een privé-IP hoort geweigerd")
85 }
86 next, err := url.Parse("https://hooks.example/hook")
87 if err != nil {
88 t.Fatal(err)
89 }
90 via := make([]*http.Request, MaxRedirects)
91 for i := range via {
92 via[i] = &http.Request{URL: next}
93 }
94 if err := checkRedirect(&http.Request{URL: next}, via); err == nil {
95 t.Fatal("te veel redirects")
96 }
97
98 origin, err := url.Parse("https://discord.example/api")
99 if err != nil {
100 t.Fatal(err)
101 }
102 other, err := url.Parse("https://other.example/land")
103 if err != nil {
104 t.Fatal(err)
105 }
106 req := &http.Request{URL: other, Header: http.Header{}, Response: &http.Response{StatusCode: http.StatusFound}}
107 req.Header.Set("Authorization", "Bearer geheim")
108 req.Header.Set("Content-Type", "application/json")
109 if err := checkRedirect(req, []*http.Request{{URL: origin}}); err != nil {
110 t.Fatal(err)
111 }
112 if req.Header.Get("Authorization") != "" {
113 t.Fatal("header naar een andere host bleef staan")
114 }
115 if req.Header.Get("Content-Type") != "application/json" {
116 t.Fatal("content-type hoort te blijven")
117 }
118 keep := &http.Request{URL: other, Header: http.Header{}, Response: &http.Response{StatusCode: http.StatusTemporaryRedirect}}
119 if err := checkRedirect(keep, []*http.Request{{URL: origin}}); err == nil {
120 t.Fatal("307 naar een andere host hoort geweigerd")
121 }
122}
internal/state/state.go added +124 −0
@@ -0,0 +1,124 @@
1 // Package state bewaart wat BlueGit nodig heeft vóór de datadisk gekozen is:
2 // de database, de sleutel en het gekozen opslagpad. De standaardmap is
3 // /var/lib/bluegit, de StateDirectory van systemd.
4 package state
5
6 import (
7 "errors"
8 "fmt"
9 "os"
10 "path/filepath"
11 "strings"
12 "syscall"
13 )
14
15 // DefaultDir is de state-map als state_path leeg is.
16 const DefaultDir = "/var/lib/bluegit"
17
18 // File is de naam van het bestand met het gekozen opslagpad.
19 const File = "storage_path"
20
21 // MinFreeBytes is de kleinste vrije ruimte die een datadisk mag hebben.
22 const MinFreeBytes = 1 << 30
23
24 // Dir kiest de state-map. Een gezet pad wint van de standaard.
25 func Dir(configured string) string {
26 if strings.TrimSpace(configured) != "" {
27 return strings.TrimSpace(configured)
28 }
29 return DefaultDir
30 }
31
32 // Read leest het opgeslagen pad. Een ontbrekend bestand is geen fout
33 // en geeft een lege string.
34 func Read(dir string) (string, error) {
35 b, err := os.ReadFile(filepath.Join(dir, File))
36 if errors.Is(err, os.ErrNotExist) {
37 return "", nil
38 }
39 if err != nil {
40 return "", err
41 }
42 return strings.TrimSpace(string(b)), nil
43 }
44
45 // Write zet het pad atomisch neer.
46 func Write(dir, path string) error {
47 if err := os.MkdirAll(dir, 0o750); err != nil {
48 return err
49 }
50 target := filepath.Join(dir, File)
51 tmp := target + ".tmp"
52 if err := os.WriteFile(tmp, []byte(path+"\n"), 0o640); err != nil {
53 return err
54 }
55 return os.Rename(tmp, target)
56 }
57
58 // Info is het resultaat van een schijfcontrole.
59 type Info struct {
60 Path string
61 Free uint64
62 Total uint64
63 }
64
65 // Inspect eist een absoluut pad dat bestaat, een map is, beschrijfbaar is
66 // en minstens MinFreeBytes vrij heeft. Bij een te volle of niet beschrijfbare
67 // map zitten Free en Total alsnog in het resultaat.
68 func Inspect(path string) (Info, error) {
69 path = strings.TrimSpace(path)
70 if path == "" {
71 return Info{}, fmt.Errorf("pad ontbreekt")
72 }
73 if strings.ContainsAny(path, "\r\n") {
74 return Info{}, fmt.Errorf("pad bevat een regeleinde")
75 }
76 if !filepath.IsAbs(path) {
77 return Info{}, fmt.Errorf("pad moet absoluut zijn")
78 }
79 path = filepath.Clean(path)
80 info := Info{Path: path}
81 st, err := os.Stat(path)
82 if err != nil {
83 if errors.Is(err, os.ErrNotExist) {
84 return info, fmt.Errorf("pad bestaat niet")
85 }
86 return info, fmt.Errorf("pad niet te lezen: %w", err)
87 }
88 if !st.IsDir() {
89 return info, fmt.Errorf("pad is geen map")
90 }
91 var fs syscall.Statfs_t
92 if err := syscall.Statfs(path, &fs); err != nil {
93 return info, fmt.Errorf("vrije ruimte niet te bepalen: %w", err)
94 }
95 info.Free = uint64(fs.Bavail) * uint64(fs.Bsize)
96 info.Total = uint64(fs.Blocks) * uint64(fs.Bsize)
97 probe := filepath.Join(path, ".bluegit-write-test")
98 f, err := os.OpenFile(probe, os.O_CREATE|os.O_EXCL|os.O_WRONLY, 0o600)
99 if err != nil {
100 return info, fmt.Errorf("pad is niet beschrijfbaar")
101 }
102 _ = f.Close()
103 _ = os.Remove(probe)
104 if info.Free < MinFreeBytes {
105 return info, fmt.Errorf("te weinig vrije ruimte: %s vrij, minimaal %s", Format(info.Free), Format(MinFreeBytes))
106 }
107 return info, nil
108 }
109
110 // Format maakt een korte grootte, bijvoorbeeld "1.5 GiB".
111 func Format(n uint64) string {
112 const unit = 1024
113 if n < unit {
114 return fmt.Sprintf("%d B", n)
115 }
116 div := uint64(unit)
117 exp := 0
118 for n/div >= unit && exp < 4 {
119 div *= unit
120 exp++
121 }
122 value := float64(n) / float64(div)
123 return fmt.Sprintf("%.1f %ciB", value, "KMGT"[exp])
124 }
@@ -0,0 +1,124 @@
1// Package state bewaart wat BlueGit nodig heeft vóór de datadisk gekozen is:
2// de database, de sleutel en het gekozen opslagpad. De standaardmap is
3// /var/lib/bluegit, de StateDirectory van systemd.
4package state
5
6import (
7 "errors"
8 "fmt"
9 "os"
10 "path/filepath"
11 "strings"
12 "syscall"
13)
14
15// DefaultDir is de state-map als state_path leeg is.
16const DefaultDir = "/var/lib/bluegit"
17
18// File is de naam van het bestand met het gekozen opslagpad.
19const File = "storage_path"
20
21// MinFreeBytes is de kleinste vrije ruimte die een datadisk mag hebben.
22const MinFreeBytes = 1 << 30
23
24// Dir kiest de state-map. Een gezet pad wint van de standaard.
25func Dir(configured string) string {
26 if strings.TrimSpace(configured) != "" {
27 return strings.TrimSpace(configured)
28 }
29 return DefaultDir
30}
31
32// Read leest het opgeslagen pad. Een ontbrekend bestand is geen fout
33// en geeft een lege string.
34func Read(dir string) (string, error) {
35 b, err := os.ReadFile(filepath.Join(dir, File))
36 if errors.Is(err, os.ErrNotExist) {
37 return "", nil
38 }
39 if err != nil {
40 return "", err
41 }
42 return strings.TrimSpace(string(b)), nil
43}
44
45// Write zet het pad atomisch neer.
46func Write(dir, path string) error {
47 if err := os.MkdirAll(dir, 0o750); err != nil {
48 return err
49 }
50 target := filepath.Join(dir, File)
51 tmp := target + ".tmp"
52 if err := os.WriteFile(tmp, []byte(path+"\n"), 0o640); err != nil {
53 return err
54 }
55 return os.Rename(tmp, target)
56}
57
58// Info is het resultaat van een schijfcontrole.
59type Info struct {
60 Path string
61 Free uint64
62 Total uint64
63}
64
65// Inspect eist een absoluut pad dat bestaat, een map is, beschrijfbaar is
66// en minstens MinFreeBytes vrij heeft. Bij een te volle of niet beschrijfbare
67// map zitten Free en Total alsnog in het resultaat.
68func Inspect(path string) (Info, error) {
69 path = strings.TrimSpace(path)
70 if path == "" {
71 return Info{}, fmt.Errorf("pad ontbreekt")
72 }
73 if strings.ContainsAny(path, "\r\n") {
74 return Info{}, fmt.Errorf("pad bevat een regeleinde")
75 }
76 if !filepath.IsAbs(path) {
77 return Info{}, fmt.Errorf("pad moet absoluut zijn")
78 }
79 path = filepath.Clean(path)
80 info := Info{Path: path}
81 st, err := os.Stat(path)
82 if err != nil {
83 if errors.Is(err, os.ErrNotExist) {
84 return info, fmt.Errorf("pad bestaat niet")
85 }
86 return info, fmt.Errorf("pad niet te lezen: %w", err)
87 }
88 if !st.IsDir() {
89 return info, fmt.Errorf("pad is geen map")
90 }
91 var fs syscall.Statfs_t
92 if err := syscall.Statfs(path, &fs); err != nil {
93 return info, fmt.Errorf("vrije ruimte niet te bepalen: %w", err)
94 }
95 info.Free = uint64(fs.Bavail) * uint64(fs.Bsize)
96 info.Total = uint64(fs.Blocks) * uint64(fs.Bsize)
97 probe := filepath.Join(path, ".bluegit-write-test")
98 f, err := os.OpenFile(probe, os.O_CREATE|os.O_EXCL|os.O_WRONLY, 0o600)
99 if err != nil {
100 return info, fmt.Errorf("pad is niet beschrijfbaar")
101 }
102 _ = f.Close()
103 _ = os.Remove(probe)
104 if info.Free < MinFreeBytes {
105 return info, fmt.Errorf("te weinig vrije ruimte: %s vrij, minimaal %s", Format(info.Free), Format(MinFreeBytes))
106 }
107 return info, nil
108}
109
110// Format maakt een korte grootte, bijvoorbeeld "1.5 GiB".
111func Format(n uint64) string {
112 const unit = 1024
113 if n < unit {
114 return fmt.Sprintf("%d B", n)
115 }
116 div := uint64(unit)
117 exp := 0
118 for n/div >= unit && exp < 4 {
119 div *= unit
120 exp++
121 }
122 value := float64(n) / float64(div)
123 return fmt.Sprintf("%.1f %ciB", value, "KMGT"[exp])
124}
internal/state/state_test.go added +53 −0
@@ -0,0 +1,53 @@
1 package state
2
3 import (
4 "os"
5 "path/filepath"
6 "strings"
7 "testing"
8 )
9
10 func TestReadWriteRoundTrip(t *testing.T) {
11 dir := t.TempDir()
12 got, err := Read(dir)
13 if err != nil || got != "" {
14 t.Fatalf("leeg: %q %v", got, err)
15 }
16 if err := Write(dir, "/data/bluegit"); err != nil {
17 t.Fatal(err)
18 }
19 got, err = Read(dir)
20 if err != nil || got != "/data/bluegit" {
21 t.Fatalf("teruggelezen %q %v", got, err)
22 }
23 }
24
25 func TestInspect(t *testing.T) {
26 if _, err := Inspect("relatief/pad"); err == nil {
27 t.Fatal("relatief pad hoort geweigerd")
28 }
29 if _, err := Inspect("/dit/pad/bestaat/niet/bluegit"); err == nil || !strings.Contains(err.Error(), "bestaat niet") {
30 t.Fatalf("ontbrekend pad: %v", err)
31 }
32 file := filepath.Join(t.TempDir(), "bestand")
33 if err := os.WriteFile(file, []byte("x"), 0o644); err != nil {
34 t.Fatal(err)
35 }
36 if _, err := Inspect(file); err == nil || !strings.Contains(err.Error(), "geen map") {
37 t.Fatalf("bestand: %v", err)
38 }
39 dir := t.TempDir()
40 info, err := Inspect(dir)
41 if err != nil {
42 t.Fatal(err)
43 }
44 if info.Free < MinFreeBytes || info.Total < info.Free {
45 t.Fatalf("ruimte free=%d total=%d", info.Free, info.Total)
46 }
47 if !strings.Contains(Format(info.Free), "iB") {
48 t.Fatal(Format(info.Free))
49 }
50 if _, err := os.Stat(filepath.Join(dir, ".bluegit-write-test")); !os.IsNotExist(err) {
51 t.Fatal("schrijftest bleef achter")
52 }
53 }
@@ -0,0 +1,53 @@
1package state
2
3import (
4 "os"
5 "path/filepath"
6 "strings"
7 "testing"
8)
9
10func TestReadWriteRoundTrip(t *testing.T) {
11 dir := t.TempDir()
12 got, err := Read(dir)
13 if err != nil || got != "" {
14 t.Fatalf("leeg: %q %v", got, err)
15 }
16 if err := Write(dir, "/data/bluegit"); err != nil {
17 t.Fatal(err)
18 }
19 got, err = Read(dir)
20 if err != nil || got != "/data/bluegit" {
21 t.Fatalf("teruggelezen %q %v", got, err)
22 }
23}
24
25func TestInspect(t *testing.T) {
26 if _, err := Inspect("relatief/pad"); err == nil {
27 t.Fatal("relatief pad hoort geweigerd")
28 }
29 if _, err := Inspect("/dit/pad/bestaat/niet/bluegit"); err == nil || !strings.Contains(err.Error(), "bestaat niet") {
30 t.Fatalf("ontbrekend pad: %v", err)
31 }
32 file := filepath.Join(t.TempDir(), "bestand")
33 if err := os.WriteFile(file, []byte("x"), 0o644); err != nil {
34 t.Fatal(err)
35 }
36 if _, err := Inspect(file); err == nil || !strings.Contains(err.Error(), "geen map") {
37 t.Fatalf("bestand: %v", err)
38 }
39 dir := t.TempDir()
40 info, err := Inspect(dir)
41 if err != nil {
42 t.Fatal(err)
43 }
44 if info.Free < MinFreeBytes || info.Total < info.Free {
45 t.Fatalf("ruimte free=%d total=%d", info.Free, info.Total)
46 }
47 if !strings.Contains(Format(info.Free), "iB") {
48 t.Fatal(Format(info.Free))
49 }
50 if _, err := os.Stat(filepath.Join(dir, ".bluegit-write-test")); !os.IsNotExist(err) {
51 t.Fatal("schrijftest bleef achter")
52 }
53}
internal/store/flow.go added +700 −0
@@ -0,0 +1,700 @@
1 package store
2
3 import (
4 "context"
5 "database/sql"
6 "encoding/json"
7 "errors"
8 "fmt"
9 "time"
10
11 "gitlab.com/Timfa/bluegit/internal/names"
12 )
13
14 // Webhook is een uitgaande melding.
15 type Webhook struct {
16 ID int64
17 ScopeKind string
18 ScopeID int64
19 Name string
20 Preset string
21 URLTemplate string
22 Headers map[string]string
23 BodyTemplate string
24 Events []string
25 BranchFilter string
26 Active bool
27 }
28
29 // CreateWebhook bewaart een webhook.
30 func (s *Store) CreateWebhook(ctx context.Context, w Webhook) (int64, error) {
31 if w.Headers == nil {
32 w.Headers = map[string]string{}
33 }
34 if w.Preset == "" {
35 w.Preset = "generic"
36 }
37 res, err := s.db.ExecContext(ctx, `INSERT INTO webhooks (scope_kind, scope_id, name, preset, url_template, headers_json, body_template, events_json, branch_filter, active, created_at)
38 VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, 1, ?)`,
39 w.ScopeKind, w.ScopeID, w.Name, w.Preset, w.URLTemplate, mustJSON(w.Headers), w.BodyTemplate, mustJSON(w.Events), w.BranchFilter, now())
40 if err != nil {
41 return 0, err
42 }
43 return res.LastInsertId()
44 }
45
46 // ListWebhooks geeft de webhooks van een repository of groep.
47 func (s *Store) ListWebhooks(ctx context.Context, scopeKind string, scopeID int64) ([]Webhook, error) {
48 rows, err := s.db.QueryContext(ctx, `SELECT id, scope_kind, scope_id, name, preset, url_template, headers_json, body_template, events_json, branch_filter, active FROM webhooks WHERE scope_kind = ? AND scope_id = ? ORDER BY id`, scopeKind, scopeID)
49 if err != nil {
50 return nil, err
51 }
52 defer rows.Close()
53 var out []Webhook
54 for rows.Next() {
55 w, err := scanWebhook(rows)
56 if err != nil {
57 return nil, err
58 }
59 out = append(out, w)
60 }
61 return out, rows.Err()
62 }
63
64 func scanWebhook(rows *sql.Rows) (Webhook, error) {
65 var w Webhook
66 var headers, events string
67 var active int
68 if err := rows.Scan(&w.ID, &w.ScopeKind, &w.ScopeID, &w.Name, &w.Preset, &w.URLTemplate, &headers, &w.BodyTemplate, &events, &w.BranchFilter, &active); err != nil {
69 return Webhook{}, err
70 }
71 w.Active = active == 1
72 _ = json.Unmarshal([]byte(headers), &w.Headers)
73 _ = json.Unmarshal([]byte(events), &w.Events)
74 if w.Headers == nil {
75 w.Headers = map[string]string{}
76 }
77 return w, nil
78 }
79
80 // DeleteWebhook verwijdert een webhook in dit scope.
81 func (s *Store) DeleteWebhook(ctx context.Context, scopeKind string, scopeID, id int64) error {
82 res, err := s.db.ExecContext(ctx, `DELETE FROM webhooks WHERE id = ? AND scope_kind = ? AND scope_id = ?`, id, scopeKind, scopeID)
83 if err != nil {
84 return err
85 }
86 n, _ := res.RowsAffected()
87 if n == 0 {
88 return errNotFound
89 }
90 return nil
91 }
92
93 // AddDelivery bewaart het resultaat van een poging.
94 func (s *Store) AddDelivery(ctx context.Context, webhookID int64, eventType string, status int, errText string) error {
95 _, err := s.db.ExecContext(ctx, `INSERT INTO webhook_deliveries (webhook_id, event_type, status_code, error, created_at) VALUES (?, ?, ?, ?, ?)`,
96 webhookID, eventType, status, trim(errText, 500), now())
97 return err
98 }
99
100 // Delivery is één poging.
101 type Delivery struct {
102 EventType string
103 StatusCode int
104 Error string
105 CreatedAt time.Time
106 }
107
108 // RecentDeliveries geeft de laatste pogingen.
109 func (s *Store) RecentDeliveries(ctx context.Context, webhookID int64) ([]Delivery, error) {
110 rows, err := s.db.QueryContext(ctx, `SELECT event_type, status_code, error, created_at FROM webhook_deliveries WHERE webhook_id = ? ORDER BY id DESC LIMIT 8`, webhookID)
111 if err != nil {
112 return nil, err
113 }
114 defer rows.Close()
115 var out []Delivery
116 for rows.Next() {
117 var d Delivery
118 var created string
119 if err := rows.Scan(&d.EventType, &d.StatusCode, &d.Error, &created); err != nil {
120 return nil, err
121 }
122 d.CreatedAt = parseTime(created)
123 out = append(out, d)
124 }
125 return out, rows.Err()
126 }
127
128 // MergeRequest is een basisverzoek om een branch samen te voegen.
129 type MergeRequest struct {
130 ID int64
131 RepoID int64
132 Number int64
133 Title string
134 Description string
135 SourceBranch string
136 TargetBranch string
137 AuthorID int64
138 Author string
139 Status string
140 CreatedAt time.Time
141 UpdatedAt time.Time
142 }
143
144 // CreateMergeRequest nummert per repository.
145 func (s *Store) CreateMergeRequest(ctx context.Context, repoID, authorID int64, title, description, source, target string) (MergeRequest, error) {
146 title = trim(title, 200)
147 if title == "" {
148 return MergeRequest{}, fmt.Errorf("een merge request heeft een titel nodig")
149 }
150 tx, err := s.db.BeginTx(ctx, nil)
151 if err != nil {
152 return MergeRequest{}, err
153 }
154 defer func() { _ = tx.Rollback() }()
155 var n int64
156 if err := tx.QueryRowContext(ctx, `SELECT COALESCE(MAX(number), 0) FROM merge_requests WHERE repo_id = ?`, repoID).Scan(&n); err != nil {
157 return MergeRequest{}, err
158 }
159 ts := now()
160 res, err := tx.ExecContext(ctx, `INSERT INTO merge_requests (repo_id, number, title, description, source_branch, target_branch, author_id, status, created_at, updated_at)
161 VALUES (?, ?, ?, ?, ?, ?, ?, 'open', ?, ?)`, repoID, n+1, title, description, source, target, authorID, ts, ts)
162 if err != nil {
163 return MergeRequest{}, err
164 }
165 id, _ := res.LastInsertId()
166 if err := tx.Commit(); err != nil {
167 return MergeRequest{}, err
168 }
169 return s.MergeRequest(ctx, repoID, id)
170 }
171
172 // MergeRequest leest op interne id.
173 func (s *Store) MergeRequest(ctx context.Context, repoID, id int64) (MergeRequest, error) {
174 row := s.db.QueryRowContext(ctx, mrSelect+` WHERE m.repo_id = ? AND m.id = ?`, repoID, id)
175 return scanMR(row)
176 }
177
178 // MergeRequestByNumber leest !nummer.
179 func (s *Store) MergeRequestByNumber(ctx context.Context, repoID, number int64) (MergeRequest, error) {
180 row := s.db.QueryRowContext(ctx, mrSelect+` WHERE m.repo_id = ? AND m.number = ?`, repoID, number)
181 return scanMR(row)
182 }
183
184 const mrSelect = `SELECT m.id, m.repo_id, m.number, m.title, m.description, m.source_branch, m.target_branch, m.author_id, u.username, m.status, m.created_at, m.updated_at
185 FROM merge_requests m JOIN users u ON u.id = m.author_id`
186
187 func scanMR(row *sql.Row) (MergeRequest, error) {
188 var m MergeRequest
189 var created, updated string
190 if err := row.Scan(&m.ID, &m.RepoID, &m.Number, &m.Title, &m.Description, &m.SourceBranch, &m.TargetBranch, &m.AuthorID, &m.Author, &m.Status, &created, &updated); err != nil {
191 if errors.Is(err, sql.ErrNoRows) {
192 return MergeRequest{}, errNotFound
193 }
194 return MergeRequest{}, err
195 }
196 m.CreatedAt = parseTime(created)
197 m.UpdatedAt = parseTime(updated)
198 return m, nil
199 }
200
201 // ListMergeRequests geeft verzoeken, open eerst.
202 func (s *Store) ListMergeRequests(ctx context.Context, repoID int64) ([]MergeRequest, error) {
203 rows, err := s.db.QueryContext(ctx, mrSelect+` WHERE m.repo_id = ? ORDER BY CASE m.status WHEN 'open' THEN 0 ELSE 1 END, m.number DESC`, repoID)
204 if err != nil {
205 return nil, err
206 }
207 defer rows.Close()
208 var out []MergeRequest
209 for rows.Next() {
210 var m MergeRequest
211 var created, updated string
212 if err := rows.Scan(&m.ID, &m.RepoID, &m.Number, &m.Title, &m.Description, &m.SourceBranch, &m.TargetBranch, &m.AuthorID, &m.Author, &m.Status, &created, &updated); err != nil {
213 return nil, err
214 }
215 m.CreatedAt = parseTime(created)
216 m.UpdatedAt = parseTime(updated)
217 out = append(out, m)
218 }
219 return out, rows.Err()
220 }
221
222 // SetMergeRequestStatus zet open, merged of closed.
223 func (s *Store) SetMergeRequestStatus(ctx context.Context, id int64, status string) error {
224 _, err := s.db.ExecContext(ctx, `UPDATE merge_requests SET status = ?, updated_at = ? WHERE id = ?`, status, now(), id)
225 return err
226 }
227
228 // NewJob is een job die nog de wachtrij in moet.
229 type NewJob struct {
230 Name string
231 Stage string
232 Position int
233 Image string
234 Script string
235 Needs []string
236 NeedsSet bool
237 Variables map[string]string
238 ArtifactPaths []string
239 ArtifactExpire time.Duration
240 AllowFailure bool
241 }
242
243 // Pipeline is een draai van blue-ci-cd.yml.
244 type Pipeline struct {
245 ID int64
246 RepoID int64
247 CommitSHA string
248 Ref string
249 Status string
250 CreatedAt time.Time
251 }
252
253 // Job is één container in een pipeline.
254 type Job struct {
255 ID int64
256 PipelineID int64
257 RepoID int64
258 Name string
259 Stage string
260 Position int
261 Status string
262 Image string
263 Script string
264 Needs []string
265 NeedsSet bool
266 Variables map[string]string
267 ArtifactPaths []string
268 ArtifactExpire time.Duration
269 AllowFailure bool
270 Log string
271 CommitSHA string
272 Ref string
273 }
274
275 // RecordConfigFailure bewaart een pipeline die niet kon starten.
276 func (s *Store) RecordConfigFailure(ctx context.Context, repoID int64, sha, ref, message string) error {
277 tx, err := s.db.BeginTx(ctx, nil)
278 if err != nil {
279 return err
280 }
281 defer func() { _ = tx.Rollback() }()
282 ts := now()
283 res, err := tx.ExecContext(ctx, `INSERT INTO pipelines (repo_id, commit_sha, ref, status, created_at, finished_at) VALUES (?, ?, ?, 'failed', ?, ?)`, repoID, sha, ref, ts, ts)
284 if err != nil {
285 return err
286 }
287 id, _ := res.LastInsertId()
288 _, err = tx.ExecContext(ctx, `INSERT INTO jobs (pipeline_id, repo_id, name, stage, position, status, image, script, needs_json, needs_set, variables_json, artifact_paths, artifact_expire_seconds, allow_failure, log, finished_at)
289 VALUES (?, ?, 'blue-ci-cd', 'test', 0, 'failed', 'alpine:3.20', 'exit 1', '[]', 0, '{}', '[]', 0, 0, ?, ?)`, id, repoID, message, ts)
290 if err != nil {
291 return err
292 }
293 return tx.Commit()
294 }
295
296 // CreatePipeline maakt een pipeline met jobs in de wachtrij.
297 func (s *Store) CreatePipeline(ctx context.Context, repoID int64, sha, ref string, jobs []NewJob) (int64, error) {
298 tx, err := s.db.BeginTx(ctx, nil)
299 if err != nil {
300 return 0, err
301 }
302 defer func() { _ = tx.Rollback() }()
303 res, err := tx.ExecContext(ctx, `INSERT INTO pipelines (repo_id, commit_sha, ref, status, created_at) VALUES (?, ?, ?, 'queued', ?)`, repoID, sha, ref, now())
304 if err != nil {
305 return 0, err
306 }
307 id, _ := res.LastInsertId()
308 for _, j := range jobs {
309 if j.Variables == nil {
310 j.Variables = map[string]string{}
311 }
312 if j.Needs == nil {
313 j.Needs = []string{}
314 }
315 if j.ArtifactPaths == nil {
316 j.ArtifactPaths = []string{}
317 }
318 _, err := tx.ExecContext(ctx, `INSERT INTO jobs (pipeline_id, repo_id, name, stage, position, status, image, script, needs_json, needs_set, variables_json, artifact_paths, artifact_expire_seconds, allow_failure, log)
319 VALUES (?, ?, ?, ?, ?, 'queued', ?, ?, ?, ?, ?, ?, ?, ?, '')`,
320 id, repoID, j.Name, j.Stage, j.Position, j.Image, j.Script, mustJSON(j.Needs), boolInt(j.NeedsSet), mustJSON(j.Variables), mustJSON(j.ArtifactPaths), int(j.ArtifactExpire/time.Second), boolInt(j.AllowFailure))
321 if err != nil {
322 return 0, err
323 }
324 }
325 if err := tx.Commit(); err != nil {
326 return 0, err
327 }
328 return id, nil
329 }
330
331 // ListPipelines geeft de nieuwste pipelines.
332 func (s *Store) ListPipelines(ctx context.Context, repoID int64) ([]Pipeline, error) {
333 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE repo_id = ? ORDER BY id DESC LIMIT 50`, repoID)
334 if err != nil {
335 return nil, err
336 }
337 defer rows.Close()
338 var out []Pipeline
339 for rows.Next() {
340 p, err := scanPipeline(rows)
341 if err != nil {
342 return nil, err
343 }
344 out = append(out, p)
345 }
346 return out, rows.Err()
347 }
348
349 func scanPipeline(rows *sql.Rows) (Pipeline, error) {
350 var p Pipeline
351 var created string
352 if err := rows.Scan(&p.ID, &p.RepoID, &p.CommitSHA, &p.Ref, &p.Status, &created); err != nil {
353 return Pipeline{}, err
354 }
355 p.CreatedAt = parseTime(created)
356 return p, nil
357 }
358
359 // PipelineByID leest één pipeline.
360 func (s *Store) PipelineByID(ctx context.Context, repoID, id int64) (Pipeline, error) {
361 var p Pipeline
362 var created string
363 err := s.db.QueryRowContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE repo_id = ? AND id = ?`, repoID, id).
364 Scan(&p.ID, &p.RepoID, &p.CommitSHA, &p.Ref, &p.Status, &created)
365 if errors.Is(err, sql.ErrNoRows) {
366 return Pipeline{}, errNotFound
367 }
368 if err != nil {
369 return Pipeline{}, err
370 }
371 p.CreatedAt = parseTime(created)
372 return p, nil
373 }
374
375 // JobsByPipeline geeft de jobs in bestandsvolgorde.
376 func (s *Store) JobsByPipeline(ctx context.Context, pipelineID int64) ([]Job, error) {
377 rows, err := s.db.QueryContext(ctx, `SELECT j.id, j.pipeline_id, j.repo_id, j.name, j.stage, j.position, j.status, j.image, j.script, j.needs_json, j.needs_set, j.variables_json, j.artifact_paths, j.artifact_expire_seconds, j.allow_failure, j.log, p.commit_sha, p.ref
378 FROM jobs j JOIN pipelines p ON p.id = j.pipeline_id WHERE j.pipeline_id = ? ORDER BY j.position, j.id`, pipelineID)
379 if err != nil {
380 return nil, err
381 }
382 defer rows.Close()
383 var out []Job
384 for rows.Next() {
385 j, err := scanJob(rows)
386 if err != nil {
387 return nil, err
388 }
389 out = append(out, j)
390 }
391 return out, rows.Err()
392 }
393
394 func scanJob(rows *sql.Rows) (Job, error) {
395 var j Job
396 var needs, vars, paths string
397 var needsSet, allow, expire int
398 if err := rows.Scan(&j.ID, &j.PipelineID, &j.RepoID, &j.Name, &j.Stage, &j.Position, &j.Status, &j.Image, &j.Script, &needs, &needsSet, &vars, &paths, &expire, &allow, &j.Log, &j.CommitSHA, &j.Ref); err != nil {
399 return Job{}, err
400 }
401 j.NeedsSet = needsSet == 1
402 j.AllowFailure = allow == 1
403 j.ArtifactExpire = time.Duration(expire) * time.Second
404 _ = json.Unmarshal([]byte(needs), &j.Needs)
405 _ = json.Unmarshal([]byte(vars), &j.Variables)
406 _ = json.Unmarshal([]byte(paths), &j.ArtifactPaths)
407 return j, nil
408 }
409
410 // ActivePipelines zijn nog niet af.
411 func (s *Store) ActivePipelines(ctx context.Context) ([]Pipeline, error) {
412 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE status IN ('queued', 'running') ORDER BY id`)
413 if err != nil {
414 return nil, err
415 }
416 defer rows.Close()
417 var out []Pipeline
418 for rows.Next() {
419 p, err := scanPipeline(rows)
420 if err != nil {
421 return nil, err
422 }
423 out = append(out, p)
424 }
425 return out, rows.Err()
426 }
427
428 // MarkJobRunning zet een wachtende job op running als hij dat nog is.
429 func (s *Store) MarkJobRunning(ctx context.Context, id int64) (bool, error) {
430 res, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = 'running', started_at = ? WHERE id = ? AND status = 'queued'`, now(), id)
431 if err != nil {
432 return false, err
433 }
434 n, _ := res.RowsAffected()
435 if n == 1 {
436 _, _ = s.db.ExecContext(ctx, `UPDATE pipelines SET status = 'running' WHERE id = (SELECT pipeline_id FROM jobs WHERE id = ?)`, id)
437 }
438 return n == 1, nil
439 }
440
441 // FinishJob schrijft het eindresultaat en het log.
442 func (s *Store) FinishJob(ctx context.Context, id int64, status, logText string) error {
443 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = ?, log = ?, finished_at = ? WHERE id = ?`, status, logText, now(), id)
444 return err
445 }
446
447 // AppendJobLog voegt tekst toe terwijl de job loopt.
448 func (s *Store) AppendJobLog(ctx context.Context, id int64, chunk string) error {
449 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET log = log || ? WHERE id = ?`, chunk, id)
450 return err
451 }
452
453 // RefreshPipelineStatus berekent de pipelinestatus uit de jobs.
454 func (s *Store) RefreshPipelineStatus(ctx context.Context, pipelineID int64) (string, error) {
455 jobs, err := s.JobsByPipeline(ctx, pipelineID)
456 if err != nil {
457 return "", err
458 }
459 status := "success"
460 for _, j := range jobs {
461 switch j.Status {
462 case "failed":
463 if !j.AllowFailure {
464 status = "failed"
465 }
466 case "queued", "running":
467 if status != "failed" {
468 status = "running"
469 }
470 }
471 }
472 if status == "success" || status == "failed" {
473 _, err = s.db.ExecContext(ctx, `UPDATE pipelines SET status = ?, finished_at = ? WHERE id = ?`, status, now(), pipelineID)
474 } else {
475 _, err = s.db.ExecContext(ctx, `UPDATE pipelines SET status = 'running' WHERE id = ?`, pipelineID)
476 }
477 return status, err
478 }
479
480 // SkipJob markeert een job die niet meer hoeft.
481 func (s *Store) SkipJob(ctx context.Context, id int64, reason string) error {
482 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = 'skipped', log = ?, finished_at = ? WHERE id = ? AND status = 'queued'`, reason, now(), id)
483 return err
484 }
485
486 // CreateJobToken maakt het token waarmee een lopende job de API aanroept.
487 func (s *Store) CreateJobToken(ctx context.Context, jobID int64) (string, error) {
488 plain, err := newToken("bgj_")
489 if err != nil {
490 return "", err
491 }
492 _, err = s.db.ExecContext(ctx, `INSERT INTO job_tokens (job_id, token_hash, created_at) VALUES (?, ?, ?)
493 ON CONFLICT(job_id) DO UPDATE SET token_hash = excluded.token_hash, created_at = excluded.created_at`,
494 jobID, hashToken(plain), now())
495 if err != nil {
496 return "", err
497 }
498 return plain, nil
499 }
500
501 // JobByToken zoekt een lopende job bij een job-token.
502 func (s *Store) JobByToken(ctx context.Context, token string) (Job, error) {
503 if len(token) < 4 || token[:4] != "bgj_" {
504 return Job{}, errNotFound
505 }
506 var jobID int64
507 err := s.db.QueryRowContext(ctx, `SELECT job_id FROM job_tokens WHERE token_hash = ?`, hashToken(token)).Scan(&jobID)
508 if errors.Is(err, sql.ErrNoRows) {
509 return Job{}, errNotFound
510 }
511 if err != nil {
512 return Job{}, err
513 }
514 rows, err := s.db.QueryContext(ctx, `SELECT j.id, j.pipeline_id, j.repo_id, j.name, j.stage, j.position, j.status, j.image, j.script, j.needs_json, j.needs_set, j.variables_json, j.artifact_paths, j.artifact_expire_seconds, j.allow_failure, j.log, p.commit_sha, p.ref
515 FROM jobs j JOIN pipelines p ON p.id = j.pipeline_id WHERE j.id = ?`, jobID)
516 if err != nil {
517 return Job{}, err
518 }
519 defer rows.Close()
520 if !rows.Next() {
521 return Job{}, errNotFound
522 }
523 return scanJob(rows)
524 }
525
526 // Artifact verwijst naar een bestand uit een job.
527 type Artifact struct {
528 ID int64
529 JobID int64
530 Path string
531 StoragePath string
532 Size int64
533 }
534
535 // AddArtifact registreert een bewaard bestand.
536 func (s *Store) AddArtifact(ctx context.Context, jobID int64, relPath, storagePath string, size int64, expires *time.Time) error {
537 var exp any
538 if expires != nil {
539 exp = expires.UTC().Format(time.RFC3339)
540 }
541 _, err := s.db.ExecContext(ctx, `INSERT INTO artifacts (job_id, path, storage_path, size, expires_at) VALUES (?, ?, ?, ?, ?)`,
542 jobID, relPath, storagePath, size, exp)
543 return err
544 }
545
546 // ArtifactPath zoekt een bestand van een job in dezelfde pipeline.
547 func (s *Store) ArtifactPath(ctx context.Context, pipelineID int64, jobName, relPath string) (string, error) {
548 var storage string
549 err := s.db.QueryRowContext(ctx, `SELECT a.storage_path FROM artifacts a JOIN jobs j ON j.id = a.job_id
550 WHERE j.pipeline_id = ? AND j.name = ? AND a.path = ? AND j.status = 'success'`, pipelineID, jobName, relPath).Scan(&storage)
551 if errors.Is(err, sql.ErrNoRows) {
552 return "", errNotFound
553 }
554 return storage, err
555 }
556
557 // Release is een publicatie op een commit.
558 type Release struct {
559 ID int64
560 RepoID int64
561 Tag string
562 CommitSHA string
563 Name string
564 Body string
565 CreatedAt time.Time
566 Assets []ReleaseAsset
567 }
568
569 // ReleaseAsset is een bestand bij een release.
570 type ReleaseAsset struct {
571 Name string
572 StoragePath string
573 Size int64
574 }
575
576 // CreateRelease bewaart de release. De bestanden staan al op storagePath.
577 func (s *Store) CreateRelease(ctx context.Context, repoID int64, tag, sha, name, body string, authorID, jobID int64, assets []ReleaseAsset) (int64, error) {
578 if err := names.ValidTag(tag); err != nil {
579 return 0, err
580 }
581 tx, err := s.db.BeginTx(ctx, nil)
582 if err != nil {
583 return 0, err
584 }
585 defer func() { _ = tx.Rollback() }()
586 var author, job any
587 if authorID != 0 {
588 author = authorID
589 }
590 if jobID != 0 {
591 job = jobID
592 }
593 res, err := tx.ExecContext(ctx, `INSERT INTO releases (repo_id, tag, commit_sha, name, body, author_id, job_id, created_at) VALUES (?, ?, ?, ?, ?, ?, ?, ?)`,
594 repoID, tag, sha, name, body, author, job, now())
595 if err != nil {
596 if containsUnique(err) {
597 return 0, fmt.Errorf("tag %s bestaat al", tag)
598 }
599 return 0, err
600 }
601 id, _ := res.LastInsertId()
602 for _, a := range assets {
603 if _, err := tx.ExecContext(ctx, `INSERT INTO release_assets (release_id, name, storage_path, size) VALUES (?, ?, ?, ?)`, id, a.Name, a.StoragePath, a.Size); err != nil {
604 return 0, err
605 }
606 }
607 if err := tx.Commit(); err != nil {
608 return 0, err
609 }
610 return id, nil
611 }
612
613 // ListReleases geeft publicaties, nieuwste eerst.
614 func (s *Store) ListReleases(ctx context.Context, repoID int64) ([]Release, error) {
615 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, tag, commit_sha, name, body, created_at FROM releases WHERE repo_id = ? ORDER BY id DESC`, repoID)
616 if err != nil {
617 return nil, err
618 }
619 defer rows.Close()
620 var out []Release
621 for rows.Next() {
622 var r Release
623 var created string
624 if err := rows.Scan(&r.ID, &r.RepoID, &r.Tag, &r.CommitSHA, &r.Name, &r.Body, &created); err != nil {
625 return nil, err
626 }
627 r.CreatedAt = parseTime(created)
628 out = append(out, r)
629 }
630 if err := rows.Err(); err != nil {
631 return nil, err
632 }
633 for i := range out {
634 assets, err := s.releaseAssets(ctx, out[i].ID)
635 if err != nil {
636 return nil, err
637 }
638 out[i].Assets = assets
639 }
640 return out, nil
641 }
642
643 // ReleaseByTag leest één release.
644 func (s *Store) ReleaseByTag(ctx context.Context, repoID int64, tag string) (Release, error) {
645 var r Release
646 var created string
647 err := s.db.QueryRowContext(ctx, `SELECT id, repo_id, tag, commit_sha, name, body, created_at FROM releases WHERE repo_id = ? AND tag = ?`, repoID, tag).
648 Scan(&r.ID, &r.RepoID, &r.Tag, &r.CommitSHA, &r.Name, &r.Body, &created)
649 if errors.Is(err, sql.ErrNoRows) {
650 return Release{}, errNotFound
651 }
652 if err != nil {
653 return Release{}, err
654 }
655 r.CreatedAt = parseTime(created)
656 r.Assets, err = s.releaseAssets(ctx, r.ID)
657 return r, err
658 }
659
660 func (s *Store) releaseAssets(ctx context.Context, id int64) ([]ReleaseAsset, error) {
661 rows, err := s.db.QueryContext(ctx, `SELECT name, storage_path, size FROM release_assets WHERE release_id = ? ORDER BY name`, id)
662 if err != nil {
663 return nil, err
664 }
665 defer rows.Close()
666 var out []ReleaseAsset
667 for rows.Next() {
668 var a ReleaseAsset
669 if err := rows.Scan(&a.Name, &a.StoragePath, &a.Size); err != nil {
670 return nil, err
671 }
672 out = append(out, a)
673 }
674 return out, rows.Err()
675 }
676
677 func trim(s string, n int) string {
678 s = string([]rune(s))
679 if len([]rune(s)) > n {
680 return string([]rune(s)[:n])
681 }
682 return s
683 }
684
685 func containsUnique(err error) bool {
686 return err != nil && (errors.Is(err, err) && (len(err.Error()) > 0 && (contains(err.Error(), "UNIQUE") || contains(err.Error(), "unique"))))
687 }
688
689 func contains(s, sub string) bool {
690 return len(s) >= len(sub) && (s == sub || len(sub) == 0 || (len(s) > 0 && (indexOf(s, sub) >= 0)))
691 }
692
693 func indexOf(s, sub string) int {
694 for i := 0; i+len(sub) <= len(s); i++ {
695 if s[i:i+len(sub)] == sub {
696 return i
697 }
698 }
699 return -1
700 }
@@ -0,0 +1,700 @@
1package store
2
3import (
4 "context"
5 "database/sql"
6 "encoding/json"
7 "errors"
8 "fmt"
9 "time"
10
11 "gitlab.com/Timfa/bluegit/internal/names"
12)
13
14// Webhook is een uitgaande melding.
15type Webhook struct {
16 ID int64
17 ScopeKind string
18 ScopeID int64
19 Name string
20 Preset string
21 URLTemplate string
22 Headers map[string]string
23 BodyTemplate string
24 Events []string
25 BranchFilter string
26 Active bool
27}
28
29// CreateWebhook bewaart een webhook.
30func (s *Store) CreateWebhook(ctx context.Context, w Webhook) (int64, error) {
31 if w.Headers == nil {
32 w.Headers = map[string]string{}
33 }
34 if w.Preset == "" {
35 w.Preset = "generic"
36 }
37 res, err := s.db.ExecContext(ctx, `INSERT INTO webhooks (scope_kind, scope_id, name, preset, url_template, headers_json, body_template, events_json, branch_filter, active, created_at)
38 VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, 1, ?)`,
39 w.ScopeKind, w.ScopeID, w.Name, w.Preset, w.URLTemplate, mustJSON(w.Headers), w.BodyTemplate, mustJSON(w.Events), w.BranchFilter, now())
40 if err != nil {
41 return 0, err
42 }
43 return res.LastInsertId()
44}
45
46// ListWebhooks geeft de webhooks van een repository of groep.
47func (s *Store) ListWebhooks(ctx context.Context, scopeKind string, scopeID int64) ([]Webhook, error) {
48 rows, err := s.db.QueryContext(ctx, `SELECT id, scope_kind, scope_id, name, preset, url_template, headers_json, body_template, events_json, branch_filter, active FROM webhooks WHERE scope_kind = ? AND scope_id = ? ORDER BY id`, scopeKind, scopeID)
49 if err != nil {
50 return nil, err
51 }
52 defer rows.Close()
53 var out []Webhook
54 for rows.Next() {
55 w, err := scanWebhook(rows)
56 if err != nil {
57 return nil, err
58 }
59 out = append(out, w)
60 }
61 return out, rows.Err()
62}
63
64func scanWebhook(rows *sql.Rows) (Webhook, error) {
65 var w Webhook
66 var headers, events string
67 var active int
68 if err := rows.Scan(&w.ID, &w.ScopeKind, &w.ScopeID, &w.Name, &w.Preset, &w.URLTemplate, &headers, &w.BodyTemplate, &events, &w.BranchFilter, &active); err != nil {
69 return Webhook{}, err
70 }
71 w.Active = active == 1
72 _ = json.Unmarshal([]byte(headers), &w.Headers)
73 _ = json.Unmarshal([]byte(events), &w.Events)
74 if w.Headers == nil {
75 w.Headers = map[string]string{}
76 }
77 return w, nil
78}
79
80// DeleteWebhook verwijdert een webhook in dit scope.
81func (s *Store) DeleteWebhook(ctx context.Context, scopeKind string, scopeID, id int64) error {
82 res, err := s.db.ExecContext(ctx, `DELETE FROM webhooks WHERE id = ? AND scope_kind = ? AND scope_id = ?`, id, scopeKind, scopeID)
83 if err != nil {
84 return err
85 }
86 n, _ := res.RowsAffected()
87 if n == 0 {
88 return errNotFound
89 }
90 return nil
91}
92
93// AddDelivery bewaart het resultaat van een poging.
94func (s *Store) AddDelivery(ctx context.Context, webhookID int64, eventType string, status int, errText string) error {
95 _, err := s.db.ExecContext(ctx, `INSERT INTO webhook_deliveries (webhook_id, event_type, status_code, error, created_at) VALUES (?, ?, ?, ?, ?)`,
96 webhookID, eventType, status, trim(errText, 500), now())
97 return err
98}
99
100// Delivery is één poging.
101type Delivery struct {
102 EventType string
103 StatusCode int
104 Error string
105 CreatedAt time.Time
106}
107
108// RecentDeliveries geeft de laatste pogingen.
109func (s *Store) RecentDeliveries(ctx context.Context, webhookID int64) ([]Delivery, error) {
110 rows, err := s.db.QueryContext(ctx, `SELECT event_type, status_code, error, created_at FROM webhook_deliveries WHERE webhook_id = ? ORDER BY id DESC LIMIT 8`, webhookID)
111 if err != nil {
112 return nil, err
113 }
114 defer rows.Close()
115 var out []Delivery
116 for rows.Next() {
117 var d Delivery
118 var created string
119 if err := rows.Scan(&d.EventType, &d.StatusCode, &d.Error, &created); err != nil {
120 return nil, err
121 }
122 d.CreatedAt = parseTime(created)
123 out = append(out, d)
124 }
125 return out, rows.Err()
126}
127
128// MergeRequest is een basisverzoek om een branch samen te voegen.
129type MergeRequest struct {
130 ID int64
131 RepoID int64
132 Number int64
133 Title string
134 Description string
135 SourceBranch string
136 TargetBranch string
137 AuthorID int64
138 Author string
139 Status string
140 CreatedAt time.Time
141 UpdatedAt time.Time
142}
143
144// CreateMergeRequest nummert per repository.
145func (s *Store) CreateMergeRequest(ctx context.Context, repoID, authorID int64, title, description, source, target string) (MergeRequest, error) {
146 title = trim(title, 200)
147 if title == "" {
148 return MergeRequest{}, fmt.Errorf("een merge request heeft een titel nodig")
149 }
150 tx, err := s.db.BeginTx(ctx, nil)
151 if err != nil {
152 return MergeRequest{}, err
153 }
154 defer func() { _ = tx.Rollback() }()
155 var n int64
156 if err := tx.QueryRowContext(ctx, `SELECT COALESCE(MAX(number), 0) FROM merge_requests WHERE repo_id = ?`, repoID).Scan(&n); err != nil {
157 return MergeRequest{}, err
158 }
159 ts := now()
160 res, err := tx.ExecContext(ctx, `INSERT INTO merge_requests (repo_id, number, title, description, source_branch, target_branch, author_id, status, created_at, updated_at)
161 VALUES (?, ?, ?, ?, ?, ?, ?, 'open', ?, ?)`, repoID, n+1, title, description, source, target, authorID, ts, ts)
162 if err != nil {
163 return MergeRequest{}, err
164 }
165 id, _ := res.LastInsertId()
166 if err := tx.Commit(); err != nil {
167 return MergeRequest{}, err
168 }
169 return s.MergeRequest(ctx, repoID, id)
170}
171
172// MergeRequest leest op interne id.
173func (s *Store) MergeRequest(ctx context.Context, repoID, id int64) (MergeRequest, error) {
174 row := s.db.QueryRowContext(ctx, mrSelect+` WHERE m.repo_id = ? AND m.id = ?`, repoID, id)
175 return scanMR(row)
176}
177
178// MergeRequestByNumber leest !nummer.
179func (s *Store) MergeRequestByNumber(ctx context.Context, repoID, number int64) (MergeRequest, error) {
180 row := s.db.QueryRowContext(ctx, mrSelect+` WHERE m.repo_id = ? AND m.number = ?`, repoID, number)
181 return scanMR(row)
182}
183
184const mrSelect = `SELECT m.id, m.repo_id, m.number, m.title, m.description, m.source_branch, m.target_branch, m.author_id, u.username, m.status, m.created_at, m.updated_at
185FROM merge_requests m JOIN users u ON u.id = m.author_id`
186
187func scanMR(row *sql.Row) (MergeRequest, error) {
188 var m MergeRequest
189 var created, updated string
190 if err := row.Scan(&m.ID, &m.RepoID, &m.Number, &m.Title, &m.Description, &m.SourceBranch, &m.TargetBranch, &m.AuthorID, &m.Author, &m.Status, &created, &updated); err != nil {
191 if errors.Is(err, sql.ErrNoRows) {
192 return MergeRequest{}, errNotFound
193 }
194 return MergeRequest{}, err
195 }
196 m.CreatedAt = parseTime(created)
197 m.UpdatedAt = parseTime(updated)
198 return m, nil
199}
200
201// ListMergeRequests geeft verzoeken, open eerst.
202func (s *Store) ListMergeRequests(ctx context.Context, repoID int64) ([]MergeRequest, error) {
203 rows, err := s.db.QueryContext(ctx, mrSelect+` WHERE m.repo_id = ? ORDER BY CASE m.status WHEN 'open' THEN 0 ELSE 1 END, m.number DESC`, repoID)
204 if err != nil {
205 return nil, err
206 }
207 defer rows.Close()
208 var out []MergeRequest
209 for rows.Next() {
210 var m MergeRequest
211 var created, updated string
212 if err := rows.Scan(&m.ID, &m.RepoID, &m.Number, &m.Title, &m.Description, &m.SourceBranch, &m.TargetBranch, &m.AuthorID, &m.Author, &m.Status, &created, &updated); err != nil {
213 return nil, err
214 }
215 m.CreatedAt = parseTime(created)
216 m.UpdatedAt = parseTime(updated)
217 out = append(out, m)
218 }
219 return out, rows.Err()
220}
221
222// SetMergeRequestStatus zet open, merged of closed.
223func (s *Store) SetMergeRequestStatus(ctx context.Context, id int64, status string) error {
224 _, err := s.db.ExecContext(ctx, `UPDATE merge_requests SET status = ?, updated_at = ? WHERE id = ?`, status, now(), id)
225 return err
226}
227
228// NewJob is een job die nog de wachtrij in moet.
229type NewJob struct {
230 Name string
231 Stage string
232 Position int
233 Image string
234 Script string
235 Needs []string
236 NeedsSet bool
237 Variables map[string]string
238 ArtifactPaths []string
239 ArtifactExpire time.Duration
240 AllowFailure bool
241}
242
243// Pipeline is een draai van blue-ci-cd.yml.
244type Pipeline struct {
245 ID int64
246 RepoID int64
247 CommitSHA string
248 Ref string
249 Status string
250 CreatedAt time.Time
251}
252
253// Job is één container in een pipeline.
254type Job struct {
255 ID int64
256 PipelineID int64
257 RepoID int64
258 Name string
259 Stage string
260 Position int
261 Status string
262 Image string
263 Script string
264 Needs []string
265 NeedsSet bool
266 Variables map[string]string
267 ArtifactPaths []string
268 ArtifactExpire time.Duration
269 AllowFailure bool
270 Log string
271 CommitSHA string
272 Ref string
273}
274
275// RecordConfigFailure bewaart een pipeline die niet kon starten.
276func (s *Store) RecordConfigFailure(ctx context.Context, repoID int64, sha, ref, message string) error {
277 tx, err := s.db.BeginTx(ctx, nil)
278 if err != nil {
279 return err
280 }
281 defer func() { _ = tx.Rollback() }()
282 ts := now()
283 res, err := tx.ExecContext(ctx, `INSERT INTO pipelines (repo_id, commit_sha, ref, status, created_at, finished_at) VALUES (?, ?, ?, 'failed', ?, ?)`, repoID, sha, ref, ts, ts)
284 if err != nil {
285 return err
286 }
287 id, _ := res.LastInsertId()
288 _, err = tx.ExecContext(ctx, `INSERT INTO jobs (pipeline_id, repo_id, name, stage, position, status, image, script, needs_json, needs_set, variables_json, artifact_paths, artifact_expire_seconds, allow_failure, log, finished_at)
289 VALUES (?, ?, 'blue-ci-cd', 'test', 0, 'failed', 'alpine:3.20', 'exit 1', '[]', 0, '{}', '[]', 0, 0, ?, ?)`, id, repoID, message, ts)
290 if err != nil {
291 return err
292 }
293 return tx.Commit()
294}
295
296// CreatePipeline maakt een pipeline met jobs in de wachtrij.
297func (s *Store) CreatePipeline(ctx context.Context, repoID int64, sha, ref string, jobs []NewJob) (int64, error) {
298 tx, err := s.db.BeginTx(ctx, nil)
299 if err != nil {
300 return 0, err
301 }
302 defer func() { _ = tx.Rollback() }()
303 res, err := tx.ExecContext(ctx, `INSERT INTO pipelines (repo_id, commit_sha, ref, status, created_at) VALUES (?, ?, ?, 'queued', ?)`, repoID, sha, ref, now())
304 if err != nil {
305 return 0, err
306 }
307 id, _ := res.LastInsertId()
308 for _, j := range jobs {
309 if j.Variables == nil {
310 j.Variables = map[string]string{}
311 }
312 if j.Needs == nil {
313 j.Needs = []string{}
314 }
315 if j.ArtifactPaths == nil {
316 j.ArtifactPaths = []string{}
317 }
318 _, err := tx.ExecContext(ctx, `INSERT INTO jobs (pipeline_id, repo_id, name, stage, position, status, image, script, needs_json, needs_set, variables_json, artifact_paths, artifact_expire_seconds, allow_failure, log)
319 VALUES (?, ?, ?, ?, ?, 'queued', ?, ?, ?, ?, ?, ?, ?, ?, '')`,
320 id, repoID, j.Name, j.Stage, j.Position, j.Image, j.Script, mustJSON(j.Needs), boolInt(j.NeedsSet), mustJSON(j.Variables), mustJSON(j.ArtifactPaths), int(j.ArtifactExpire/time.Second), boolInt(j.AllowFailure))
321 if err != nil {
322 return 0, err
323 }
324 }
325 if err := tx.Commit(); err != nil {
326 return 0, err
327 }
328 return id, nil
329}
330
331// ListPipelines geeft de nieuwste pipelines.
332func (s *Store) ListPipelines(ctx context.Context, repoID int64) ([]Pipeline, error) {
333 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE repo_id = ? ORDER BY id DESC LIMIT 50`, repoID)
334 if err != nil {
335 return nil, err
336 }
337 defer rows.Close()
338 var out []Pipeline
339 for rows.Next() {
340 p, err := scanPipeline(rows)
341 if err != nil {
342 return nil, err
343 }
344 out = append(out, p)
345 }
346 return out, rows.Err()
347}
348
349func scanPipeline(rows *sql.Rows) (Pipeline, error) {
350 var p Pipeline
351 var created string
352 if err := rows.Scan(&p.ID, &p.RepoID, &p.CommitSHA, &p.Ref, &p.Status, &created); err != nil {
353 return Pipeline{}, err
354 }
355 p.CreatedAt = parseTime(created)
356 return p, nil
357}
358
359// PipelineByID leest één pipeline.
360func (s *Store) PipelineByID(ctx context.Context, repoID, id int64) (Pipeline, error) {
361 var p Pipeline
362 var created string
363 err := s.db.QueryRowContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE repo_id = ? AND id = ?`, repoID, id).
364 Scan(&p.ID, &p.RepoID, &p.CommitSHA, &p.Ref, &p.Status, &created)
365 if errors.Is(err, sql.ErrNoRows) {
366 return Pipeline{}, errNotFound
367 }
368 if err != nil {
369 return Pipeline{}, err
370 }
371 p.CreatedAt = parseTime(created)
372 return p, nil
373}
374
375// JobsByPipeline geeft de jobs in bestandsvolgorde.
376func (s *Store) JobsByPipeline(ctx context.Context, pipelineID int64) ([]Job, error) {
377 rows, err := s.db.QueryContext(ctx, `SELECT j.id, j.pipeline_id, j.repo_id, j.name, j.stage, j.position, j.status, j.image, j.script, j.needs_json, j.needs_set, j.variables_json, j.artifact_paths, j.artifact_expire_seconds, j.allow_failure, j.log, p.commit_sha, p.ref
378 FROM jobs j JOIN pipelines p ON p.id = j.pipeline_id WHERE j.pipeline_id = ? ORDER BY j.position, j.id`, pipelineID)
379 if err != nil {
380 return nil, err
381 }
382 defer rows.Close()
383 var out []Job
384 for rows.Next() {
385 j, err := scanJob(rows)
386 if err != nil {
387 return nil, err
388 }
389 out = append(out, j)
390 }
391 return out, rows.Err()
392}
393
394func scanJob(rows *sql.Rows) (Job, error) {
395 var j Job
396 var needs, vars, paths string
397 var needsSet, allow, expire int
398 if err := rows.Scan(&j.ID, &j.PipelineID, &j.RepoID, &j.Name, &j.Stage, &j.Position, &j.Status, &j.Image, &j.Script, &needs, &needsSet, &vars, &paths, &expire, &allow, &j.Log, &j.CommitSHA, &j.Ref); err != nil {
399 return Job{}, err
400 }
401 j.NeedsSet = needsSet == 1
402 j.AllowFailure = allow == 1
403 j.ArtifactExpire = time.Duration(expire) * time.Second
404 _ = json.Unmarshal([]byte(needs), &j.Needs)
405 _ = json.Unmarshal([]byte(vars), &j.Variables)
406 _ = json.Unmarshal([]byte(paths), &j.ArtifactPaths)
407 return j, nil
408}
409
410// ActivePipelines zijn nog niet af.
411func (s *Store) ActivePipelines(ctx context.Context) ([]Pipeline, error) {
412 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, commit_sha, ref, status, created_at FROM pipelines WHERE status IN ('queued', 'running') ORDER BY id`)
413 if err != nil {
414 return nil, err
415 }
416 defer rows.Close()
417 var out []Pipeline
418 for rows.Next() {
419 p, err := scanPipeline(rows)
420 if err != nil {
421 return nil, err
422 }
423 out = append(out, p)
424 }
425 return out, rows.Err()
426}
427
428// MarkJobRunning zet een wachtende job op running als hij dat nog is.
429func (s *Store) MarkJobRunning(ctx context.Context, id int64) (bool, error) {
430 res, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = 'running', started_at = ? WHERE id = ? AND status = 'queued'`, now(), id)
431 if err != nil {
432 return false, err
433 }
434 n, _ := res.RowsAffected()
435 if n == 1 {
436 _, _ = s.db.ExecContext(ctx, `UPDATE pipelines SET status = 'running' WHERE id = (SELECT pipeline_id FROM jobs WHERE id = ?)`, id)
437 }
438 return n == 1, nil
439}
440
441// FinishJob schrijft het eindresultaat en het log.
442func (s *Store) FinishJob(ctx context.Context, id int64, status, logText string) error {
443 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = ?, log = ?, finished_at = ? WHERE id = ?`, status, logText, now(), id)
444 return err
445}
446
447// AppendJobLog voegt tekst toe terwijl de job loopt.
448func (s *Store) AppendJobLog(ctx context.Context, id int64, chunk string) error {
449 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET log = log || ? WHERE id = ?`, chunk, id)
450 return err
451}
452
453// RefreshPipelineStatus berekent de pipelinestatus uit de jobs.
454func (s *Store) RefreshPipelineStatus(ctx context.Context, pipelineID int64) (string, error) {
455 jobs, err := s.JobsByPipeline(ctx, pipelineID)
456 if err != nil {
457 return "", err
458 }
459 status := "success"
460 for _, j := range jobs {
461 switch j.Status {
462 case "failed":
463 if !j.AllowFailure {
464 status = "failed"
465 }
466 case "queued", "running":
467 if status != "failed" {
468 status = "running"
469 }
470 }
471 }
472 if status == "success" || status == "failed" {
473 _, err = s.db.ExecContext(ctx, `UPDATE pipelines SET status = ?, finished_at = ? WHERE id = ?`, status, now(), pipelineID)
474 } else {
475 _, err = s.db.ExecContext(ctx, `UPDATE pipelines SET status = 'running' WHERE id = ?`, pipelineID)
476 }
477 return status, err
478}
479
480// SkipJob markeert een job die niet meer hoeft.
481func (s *Store) SkipJob(ctx context.Context, id int64, reason string) error {
482 _, err := s.db.ExecContext(ctx, `UPDATE jobs SET status = 'skipped', log = ?, finished_at = ? WHERE id = ? AND status = 'queued'`, reason, now(), id)
483 return err
484}
485
486// CreateJobToken maakt het token waarmee een lopende job de API aanroept.
487func (s *Store) CreateJobToken(ctx context.Context, jobID int64) (string, error) {
488 plain, err := newToken("bgj_")
489 if err != nil {
490 return "", err
491 }
492 _, err = s.db.ExecContext(ctx, `INSERT INTO job_tokens (job_id, token_hash, created_at) VALUES (?, ?, ?)
493 ON CONFLICT(job_id) DO UPDATE SET token_hash = excluded.token_hash, created_at = excluded.created_at`,
494 jobID, hashToken(plain), now())
495 if err != nil {
496 return "", err
497 }
498 return plain, nil
499}
500
501// JobByToken zoekt een lopende job bij een job-token.
502func (s *Store) JobByToken(ctx context.Context, token string) (Job, error) {
503 if len(token) < 4 || token[:4] != "bgj_" {
504 return Job{}, errNotFound
505 }
506 var jobID int64
507 err := s.db.QueryRowContext(ctx, `SELECT job_id FROM job_tokens WHERE token_hash = ?`, hashToken(token)).Scan(&jobID)
508 if errors.Is(err, sql.ErrNoRows) {
509 return Job{}, errNotFound
510 }
511 if err != nil {
512 return Job{}, err
513 }
514 rows, err := s.db.QueryContext(ctx, `SELECT j.id, j.pipeline_id, j.repo_id, j.name, j.stage, j.position, j.status, j.image, j.script, j.needs_json, j.needs_set, j.variables_json, j.artifact_paths, j.artifact_expire_seconds, j.allow_failure, j.log, p.commit_sha, p.ref
515 FROM jobs j JOIN pipelines p ON p.id = j.pipeline_id WHERE j.id = ?`, jobID)
516 if err != nil {
517 return Job{}, err
518 }
519 defer rows.Close()
520 if !rows.Next() {
521 return Job{}, errNotFound
522 }
523 return scanJob(rows)
524}
525
526// Artifact verwijst naar een bestand uit een job.
527type Artifact struct {
528 ID int64
529 JobID int64
530 Path string
531 StoragePath string
532 Size int64
533}
534
535// AddArtifact registreert een bewaard bestand.
536func (s *Store) AddArtifact(ctx context.Context, jobID int64, relPath, storagePath string, size int64, expires *time.Time) error {
537 var exp any
538 if expires != nil {
539 exp = expires.UTC().Format(time.RFC3339)
540 }
541 _, err := s.db.ExecContext(ctx, `INSERT INTO artifacts (job_id, path, storage_path, size, expires_at) VALUES (?, ?, ?, ?, ?)`,
542 jobID, relPath, storagePath, size, exp)
543 return err
544}
545
546// ArtifactPath zoekt een bestand van een job in dezelfde pipeline.
547func (s *Store) ArtifactPath(ctx context.Context, pipelineID int64, jobName, relPath string) (string, error) {
548 var storage string
549 err := s.db.QueryRowContext(ctx, `SELECT a.storage_path FROM artifacts a JOIN jobs j ON j.id = a.job_id
550 WHERE j.pipeline_id = ? AND j.name = ? AND a.path = ? AND j.status = 'success'`, pipelineID, jobName, relPath).Scan(&storage)
551 if errors.Is(err, sql.ErrNoRows) {
552 return "", errNotFound
553 }
554 return storage, err
555}
556
557// Release is een publicatie op een commit.
558type Release struct {
559 ID int64
560 RepoID int64
561 Tag string
562 CommitSHA string
563 Name string
564 Body string
565 CreatedAt time.Time
566 Assets []ReleaseAsset
567}
568
569// ReleaseAsset is een bestand bij een release.
570type ReleaseAsset struct {
571 Name string
572 StoragePath string
573 Size int64
574}
575
576// CreateRelease bewaart de release. De bestanden staan al op storagePath.
577func (s *Store) CreateRelease(ctx context.Context, repoID int64, tag, sha, name, body string, authorID, jobID int64, assets []ReleaseAsset) (int64, error) {
578 if err := names.ValidTag(tag); err != nil {
579 return 0, err
580 }
581 tx, err := s.db.BeginTx(ctx, nil)
582 if err != nil {
583 return 0, err
584 }
585 defer func() { _ = tx.Rollback() }()
586 var author, job any
587 if authorID != 0 {
588 author = authorID
589 }
590 if jobID != 0 {
591 job = jobID
592 }
593 res, err := tx.ExecContext(ctx, `INSERT INTO releases (repo_id, tag, commit_sha, name, body, author_id, job_id, created_at) VALUES (?, ?, ?, ?, ?, ?, ?, ?)`,
594 repoID, tag, sha, name, body, author, job, now())
595 if err != nil {
596 if containsUnique(err) {
597 return 0, fmt.Errorf("tag %s bestaat al", tag)
598 }
599 return 0, err
600 }
601 id, _ := res.LastInsertId()
602 for _, a := range assets {
603 if _, err := tx.ExecContext(ctx, `INSERT INTO release_assets (release_id, name, storage_path, size) VALUES (?, ?, ?, ?)`, id, a.Name, a.StoragePath, a.Size); err != nil {
604 return 0, err
605 }
606 }
607 if err := tx.Commit(); err != nil {
608 return 0, err
609 }
610 return id, nil
611}
612
613// ListReleases geeft publicaties, nieuwste eerst.
614func (s *Store) ListReleases(ctx context.Context, repoID int64) ([]Release, error) {
615 rows, err := s.db.QueryContext(ctx, `SELECT id, repo_id, tag, commit_sha, name, body, created_at FROM releases WHERE repo_id = ? ORDER BY id DESC`, repoID)
616 if err != nil {
617 return nil, err
618 }
619 defer rows.Close()
620 var out []Release
621 for rows.Next() {
622 var r Release
623 var created string
624 if err := rows.Scan(&r.ID, &r.RepoID, &r.Tag, &r.CommitSHA, &r.Name, &r.Body, &created); err != nil {
625 return nil, err
626 }
627 r.CreatedAt = parseTime(created)
628 out = append(out, r)
629 }
630 if err := rows.Err(); err != nil {
631 return nil, err
632 }
633 for i := range out {
634 assets, err := s.releaseAssets(ctx, out[i].ID)
635 if err != nil {
636 return nil, err
637 }
638 out[i].Assets = assets
639 }
640 return out, nil
641}
642
643// ReleaseByTag leest één release.
644func (s *Store) ReleaseByTag(ctx context.Context, repoID int64, tag string) (Release, error) {
645 var r Release
646 var created string
647 err := s.db.QueryRowContext(ctx, `SELECT id, repo_id, tag, commit_sha, name, body, created_at FROM releases WHERE repo_id = ? AND tag = ?`, repoID, tag).
648 Scan(&r.ID, &r.RepoID, &r.Tag, &r.CommitSHA, &r.Name, &r.Body, &created)
649 if errors.Is(err, sql.ErrNoRows) {
650 return Release{}, errNotFound
651 }
652 if err != nil {
653 return Release{}, err
654 }
655 r.CreatedAt = parseTime(created)
656 r.Assets, err = s.releaseAssets(ctx, r.ID)
657 return r, err
658}
659
660func (s *Store) releaseAssets(ctx context.Context, id int64) ([]ReleaseAsset, error) {
661 rows, err := s.db.QueryContext(ctx, `SELECT name, storage_path, size FROM release_assets WHERE release_id = ? ORDER BY name`, id)
662 if err != nil {
663 return nil, err
664 }
665 defer rows.Close()
666 var out []ReleaseAsset
667 for rows.Next() {
668 var a ReleaseAsset
669 if err := rows.Scan(&a.Name, &a.StoragePath, &a.Size); err != nil {
670 return nil, err
671 }
672 out = append(out, a)
673 }
674 return out, rows.Err()
675}
676
677func trim(s string, n int) string {
678 s = string([]rune(s))
679 if len([]rune(s)) > n {
680 return string([]rune(s)[:n])
681 }
682 return s
683}
684
685func containsUnique(err error) bool {
686 return err != nil && (errors.Is(err, err) && (len(err.Error()) > 0 && (contains(err.Error(), "UNIQUE") || contains(err.Error(), "unique"))))
687}
688
689func contains(s, sub string) bool {
690 return len(s) >= len(sub) && (s == sub || len(sub) == 0 || (len(s) > 0 && (indexOf(s, sub) >= 0)))
691}
692
693func indexOf(s, sub string) int {
694 for i := 0; i+len(sub) <= len(s); i++ {
695 if s[i:i+len(sub)] == sub {
696 return i
697 }
698 }
699 return -1
700}
internal/store/repos.go added +578 −0
@@ -0,0 +1,578 @@
1 package store
2
3 import (
4 "context"
5 "database/sql"
6 "errors"
7 "fmt"
8 "strings"
9 "time"
10
11 "gitlab.com/Timfa/bluegit/internal/access"
12 "gitlab.com/Timfa/bluegit/internal/names"
13 )
14
15 // Group is een verzameling repositories en leden.
16 type Group struct {
17 ID int64
18 Name string
19 Path string
20 Description string
21 CreatedBy int64
22 CreatedAt time.Time
23 }
24
25 // Repo is een git-repository van een gebruiker of een groep.
26 type Repo struct {
27 ID int64
28 OwnerKind string
29 OwnerID int64
30 OwnerPath string
31 Name string
32 Description string
33 DefaultBranch string
34 Visibility string
35 CreatedAt time.Time
36 }
37
38 // FullPath is owner/naam.
39 func (r Repo) FullPath() string { return r.OwnerPath + "/" + r.Name }
40
41 // CreateGroup maakt een groep. De maker wordt beheerder.
42 func (s *Store) CreateGroup(ctx context.Context, creator int64, name, path, description string) (Group, error) {
43 name = strings.TrimSpace(name)
44 path = strings.ToLower(strings.TrimSpace(path))
45 if name == "" {
46 return Group{}, fmt.Errorf("de groep heeft een naam nodig")
47 }
48 if err := names.ValidGroupPath(path); err != nil {
49 return Group{}, err
50 }
51 if err := s.ensurePathFree(ctx, path); err != nil {
52 return Group{}, err
53 }
54 res, err := s.db.ExecContext(ctx, `INSERT INTO groups (name, path, description, created_by, created_at) VALUES (?, ?, ?, ?, ?)`,
55 name, path, strings.TrimSpace(description), creator, now())
56 if err != nil {
57 return Group{}, err
58 }
59 id, _ := res.LastInsertId()
60 if _, err := s.db.ExecContext(ctx, `INSERT INTO group_members (group_id, user_id, role) VALUES (?, ?, ?)`, id, creator, string(access.RoleMaintainer)); err != nil {
61 return Group{}, err
62 }
63 return s.GroupByID(ctx, id)
64 }
65
66 func (s *Store) ensurePathFree(ctx context.Context, path string) error {
67 var n int
68 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ?`, path).Scan(&n); err != nil {
69 return err
70 }
71 if n > 0 {
72 return fmt.Errorf("pad %s is al een gebruiker", path)
73 }
74 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, path).Scan(&n); err != nil {
75 return err
76 }
77 if n > 0 {
78 return fmt.Errorf("pad %s is al een groep", path)
79 }
80 return nil
81 }
82
83 // GroupByPath leest een groep.
84 func (s *Store) GroupByPath(ctx context.Context, path string) (Group, error) {
85 row := s.db.QueryRowContext(ctx, `SELECT id, name, path, description, created_by, created_at FROM groups WHERE path = ?`, path)
86 return scanGroup(row)
87 }
88
89 // GroupByID leest een groep.
90 func (s *Store) GroupByID(ctx context.Context, id int64) (Group, error) {
91 row := s.db.QueryRowContext(ctx, `SELECT id, name, path, description, created_by, created_at FROM groups WHERE id = ?`, id)
92 return scanGroup(row)
93 }
94
95 func scanGroup(row *sql.Row) (Group, error) {
96 var g Group
97 var created string
98 if err := row.Scan(&g.ID, &g.Name, &g.Path, &g.Description, &g.CreatedBy, &created); err != nil {
99 if errors.Is(err, sql.ErrNoRows) {
100 return Group{}, errNotFound
101 }
102 return Group{}, err
103 }
104 g.CreatedAt = parseTime(created)
105 return g, nil
106 }
107
108 // GroupRole is de rol van een gebruiker in een groep.
109 // Installatiebeheer geeft geen lidmaatschap.
110 func (s *Store) GroupRole(ctx context.Context, groupID, userID int64) (access.Role, error) {
111 if userID == 0 {
112 return access.RoleNone, nil
113 }
114 var role string
115 err := s.db.QueryRowContext(ctx, `SELECT role FROM group_members WHERE group_id = ? AND user_id = ?`, groupID, userID).Scan(&role)
116 if errors.Is(err, sql.ErrNoRows) {
117 return access.RoleNone, nil
118 }
119 if err != nil {
120 return access.RoleNone, err
121 }
122 return access.Role(role), nil
123 }
124
125 // ListGroups geeft de groepen waarvan deze gebruiker lid is.
126 func (s *Store) ListGroups(ctx context.Context, userID int64) ([]Group, error) {
127 q := `SELECT id, name, path, description, created_by, created_at FROM groups WHERE id IN (SELECT group_id FROM group_members WHERE user_id = ?) ORDER BY path`
128 args := []any{userID}
129 rows, err := s.db.QueryContext(ctx, q, args...)
130 if err != nil {
131 return nil, err
132 }
133 defer rows.Close()
134 var out []Group
135 for rows.Next() {
136 var g Group
137 var created string
138 if err := rows.Scan(&g.ID, &g.Name, &g.Path, &g.Description, &g.CreatedBy, &created); err != nil {
139 return nil, err
140 }
141 g.CreatedAt = parseTime(created)
142 out = append(out, g)
143 }
144 return out, rows.Err()
145 }
146
147 // CreateRepo maakt de metadata. De schijfmap maakt de aanroeper.
148 func (s *Store) CreateRepo(ctx context.Context, ownerKind string, ownerID int64, name, description, defaultBranch, visibility string) (Repo, error) {
149 if ownerKind != "user" && ownerKind != "group" {
150 return Repo{}, fmt.Errorf("eigenaar moet user of group zijn")
151 }
152 if err := names.ValidRepoName(name); err != nil {
153 return Repo{}, err
154 }
155 if visibility != "public" && visibility != "private" {
156 return Repo{}, fmt.Errorf("zichtbaarheid moet public of private zijn")
157 }
158 if defaultBranch == "" {
159 defaultBranch = "master"
160 }
161 if ownerKind == "user" {
162 u, err := s.UserByID(ctx, ownerID)
163 if err != nil {
164 return Repo{}, err
165 }
166 var n int
167 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, u.Username).Scan(&n); err != nil {
168 return Repo{}, err
169 }
170 if n > 0 {
171 return Repo{}, fmt.Errorf("er bestaat al een groep %s; persoonlijke repositories zijn dan niet bereikbaar", u.Username)
172 }
173 }
174 res, err := s.db.ExecContext(ctx, `INSERT INTO repos (owner_kind, owner_id, name, description, default_branch, visibility, created_at) VALUES (?, ?, ?, ?, ?, ?, ?)`,
175 ownerKind, ownerID, name, strings.TrimSpace(description), defaultBranch, visibility, now())
176 if err != nil {
177 if strings.Contains(err.Error(), "UNIQUE") {
178 return Repo{}, fmt.Errorf("er is al een repository %s", name)
179 }
180 return Repo{}, err
181 }
182 id, _ := res.LastInsertId()
183 return s.RepoByID(ctx, id)
184 }
185
186 // RepoByID leest een repository.
187 func (s *Store) RepoByID(ctx context.Context, id int64) (Repo, error) {
188 row := s.db.QueryRowContext(ctx, repoSelect+` WHERE r.id = ?`, id)
189 return scanRepo(row)
190 }
191
192 // RepoByPath leest owner/naam.
193 func (s *Store) RepoByPath(ctx context.Context, owner, name string) (Repo, error) {
194 row := s.db.QueryRowContext(ctx, repoSelect+`
195 WHERE r.name = ? AND (
196 (r.owner_kind = 'user' AND r.owner_id = (SELECT id FROM users WHERE username = ?))
197 OR (r.owner_kind = 'group' AND r.owner_id = (SELECT id FROM groups WHERE path = ?))
198 )`, name, owner, owner)
199 return scanRepo(row)
200 }
201
202 const repoSelect = `
203 SELECT r.id, r.owner_kind, r.owner_id,
204 CASE r.owner_kind WHEN 'user' THEN (SELECT username FROM users WHERE id = r.owner_id) ELSE (SELECT path FROM groups WHERE id = r.owner_id) END,
205 r.name, r.description, r.default_branch, r.visibility, r.created_at
206 FROM repos r`
207
208 func scanRepo(row *sql.Row) (Repo, error) {
209 var r Repo
210 var created string
211 var owner sql.NullString
212 if err := row.Scan(&r.ID, &r.OwnerKind, &r.OwnerID, &owner, &r.Name, &r.Description, &r.DefaultBranch, &r.Visibility, &created); err != nil {
213 if errors.Is(err, sql.ErrNoRows) {
214 return Repo{}, errNotFound
215 }
216 return Repo{}, err
217 }
218 r.OwnerPath = owner.String
219 r.CreatedAt = parseTime(created)
220 return r, nil
221 }
222
223 // UpdateRepo wijzigt beschrijving en zichtbaarheid.
224 func (s *Store) UpdateRepo(ctx context.Context, id int64, description, visibility string) error {
225 if visibility != "public" && visibility != "private" {
226 return fmt.Errorf("zichtbaarheid moet public of private zijn")
227 }
228 _, err := s.db.ExecContext(ctx, `UPDATE repos SET description = ?, visibility = ? WHERE id = ?`, strings.TrimSpace(description), visibility, id)
229 return err
230 }
231
232 // DeleteRepo verwijdert de metadata. Bestanden verwijdert de aanroeper.
233 func (s *Store) DeleteRepo(ctx context.Context, id int64) error {
234 _, err := s.db.ExecContext(ctx, `DELETE FROM repos WHERE id = ?`, id)
235 return err
236 }
237
238 // ListRepoIDs geeft repositories die deze gebruiker mag zien:
239 // openbare repositories, eigen repositories, repositories van een groep
240 // waarvan hij lid is, en repositories met een rechtstreeks lidmaatschap.
241 // Installatiebeheer voegt daar niets aan toe.
242 func (s *Store) ListRepoIDs(ctx context.Context, userID int64) ([]int64, error) {
243 q := `SELECT id FROM repos WHERE visibility = 'public'`
244 args := []any{}
245 if userID != 0 {
246 q = `SELECT DISTINCT id FROM repos WHERE visibility = 'public'
247 OR (owner_kind = 'user' AND owner_id = ?)
248 OR (owner_kind = 'group' AND owner_id IN (SELECT group_id FROM group_members WHERE user_id = ?))
249 OR id IN (SELECT repo_id FROM repo_members WHERE user_id = ?)`
250 args = []any{userID, userID, userID}
251 }
252 q += ` ORDER BY id DESC`
253 rows, err := s.db.QueryContext(ctx, q, args...)
254 if err != nil {
255 return nil, err
256 }
257 defer rows.Close()
258 var ids []int64
259 for rows.Next() {
260 var id int64
261 if err := rows.Scan(&id); err != nil {
262 return nil, err
263 }
264 ids = append(ids, id)
265 }
266 return ids, rows.Err()
267 }
268
269 // ReposByGroup geeft de repositories van een groep.
270 func (s *Store) ReposByGroup(ctx context.Context, groupID int64) ([]Repo, error) {
271 rows, err := s.db.QueryContext(ctx, repoSelect+` WHERE r.owner_kind = 'group' AND r.owner_id = ? ORDER BY r.name`, groupID)
272 if err != nil {
273 return nil, err
274 }
275 defer rows.Close()
276 return scanRepos(rows)
277 }
278
279 // ReposByIDs laadt een lijst.
280 func (s *Store) ReposByIDs(ctx context.Context, ids []int64) ([]Repo, error) {
281 var out []Repo
282 for _, id := range ids {
283 r, err := s.RepoByID(ctx, id)
284 if err != nil {
285 return nil, err
286 }
287 out = append(out, r)
288 }
289 return out, nil
290 }
291
292 func scanRepos(rows *sql.Rows) ([]Repo, error) {
293 var out []Repo
294 for rows.Next() {
295 var r Repo
296 var created string
297 var owner sql.NullString
298 if err := rows.Scan(&r.ID, &r.OwnerKind, &r.OwnerID, &owner, &r.Name, &r.Description, &r.DefaultBranch, &r.Visibility, &created); err != nil {
299 return nil, err
300 }
301 r.OwnerPath = owner.String
302 r.CreatedAt = parseTime(created)
303 out = append(out, r)
304 }
305 return out, rows.Err()
306 }
307
308 // AllRepos is voor het verversen van hooks bij het starten.
309 func (s *Store) AllRepos(ctx context.Context) ([]Repo, error) {
310 rows, err := s.db.QueryContext(ctx, repoSelect+` ORDER BY r.id`)
311 if err != nil {
312 return nil, err
313 }
314 defer rows.Close()
315 return scanRepos(rows)
316 }
317
318 // EffectiveRole past de rolregels toe op een repository.
319 func (s *Store) EffectiveRole(ctx context.Context, userID, repoID int64) (access.Role, error) {
320 if userID == 0 {
321 return access.RoleNone, nil
322 }
323 if _, err := s.UserByID(ctx, userID); err != nil {
324 return access.RoleNone, err
325 }
326 repo, err := s.RepoByID(ctx, repoID)
327 if err != nil {
328 return access.RoleNone, err
329 }
330 in := access.Input{}
331 if repo.OwnerKind == "user" && repo.OwnerID == userID {
332 in.UserOwner = true
333 }
334 if repo.OwnerKind == "group" {
335 var role string
336 err := s.db.QueryRowContext(ctx, `SELECT role FROM group_members WHERE group_id = ? AND user_id = ?`, repo.OwnerID, userID).Scan(&role)
337 if err != nil && !errors.Is(err, sql.ErrNoRows) {
338 return access.RoleNone, err
339 }
340 if err == nil {
341 in.GroupRole = access.Role(role)
342 }
343 }
344 var role string
345 err = s.db.QueryRowContext(ctx, `SELECT role FROM repo_members WHERE repo_id = ? AND user_id = ?`, repoID, userID).Scan(&role)
346 if err != nil && !errors.Is(err, sql.ErrNoRows) {
347 return access.RoleNone, err
348 }
349 if err == nil {
350 in.RepoRole = access.Role(role)
351 }
352 return access.Resolve(in), nil
353 }
354
355 // Member is een lid of een uitnodiging op gebruikersnaam.
356 type Member struct {
357 UserID int64
358 Username string
359 Role access.Role
360 Pending bool
361 }
362
363 // SetMember zet een lidmaatschap. Een onbekende naam blijft wachten tot de eerste login.
364 func (s *Store) SetMember(ctx context.Context, scopeKind string, scopeID int64, username string, role access.Role) error {
365 if scopeKind != "repo" && scopeKind != "group" {
366 return fmt.Errorf("scope moet repo of group zijn")
367 }
368 if _, err := access.ParseRole(string(role)); err != nil {
369 return err
370 }
371 username = strings.ToLower(strings.TrimSpace(username))
372 if err := names.ValidUsername(username); err != nil {
373 return err
374 }
375 u, err := s.UserByUsername(ctx, username)
376 if IsNotFound(err) {
377 _, err = s.db.ExecContext(ctx, `INSERT INTO pending_members (scope_kind, scope_id, username, role) VALUES (?, ?, ?, ?)
378 ON CONFLICT(scope_kind, scope_id, username) DO UPDATE SET role = excluded.role`, scopeKind, scopeID, username, string(role))
379 return err
380 }
381 if err != nil {
382 return err
383 }
384 table, col := "repo_members", "repo_id"
385 if scopeKind == "group" {
386 table, col = "group_members", "group_id"
387 }
388 _, err = s.db.ExecContext(ctx, `INSERT INTO `+table+` (`+col+`, user_id, role) VALUES (?, ?, ?)
389 ON CONFLICT(`+col+`, user_id) DO UPDATE SET role = excluded.role`, scopeID, u.ID, string(role))
390 return err
391 }
392
393 // RemoveMember haalt een lid of een uitnodiging weg.
394 func (s *Store) RemoveMember(ctx context.Context, scopeKind string, scopeID int64, username string) error {
395 username = strings.ToLower(strings.TrimSpace(username))
396 _, err := s.db.ExecContext(ctx, `DELETE FROM pending_members WHERE scope_kind = ? AND scope_id = ? AND username = ?`, scopeKind, scopeID, username)
397 if err != nil {
398 return err
399 }
400 u, err := s.UserByUsername(ctx, username)
401 if IsNotFound(err) {
402 return nil
403 }
404 if err != nil {
405 return err
406 }
407 if scopeKind == "group" {
408 _, err = s.db.ExecContext(ctx, `DELETE FROM group_members WHERE group_id = ? AND user_id = ?`, scopeID, u.ID)
409 return err
410 }
411 _, err = s.db.ExecContext(ctx, `DELETE FROM repo_members WHERE repo_id = ? AND user_id = ?`, scopeID, u.ID)
412 return err
413 }
414
415 // ListMembers geeft leden van een repository of groep, plus open uitnodigingen.
416 func (s *Store) ListMembers(ctx context.Context, scopeKind string, scopeID int64) ([]Member, error) {
417 var q string
418 if scopeKind == "group" {
419 q = `SELECT u.id, u.username, m.role FROM group_members m JOIN users u ON u.id = m.user_id WHERE m.group_id = ? ORDER BY u.username`
420 } else {
421 q = `SELECT u.id, u.username, m.role FROM repo_members m JOIN users u ON u.id = m.user_id WHERE m.repo_id = ? ORDER BY u.username`
422 }
423 rows, err := s.db.QueryContext(ctx, q, scopeID)
424 if err != nil {
425 return nil, err
426 }
427 defer rows.Close()
428 var out []Member
429 for rows.Next() {
430 var m Member
431 var role string
432 if err := rows.Scan(&m.UserID, &m.Username, &role); err != nil {
433 return nil, err
434 }
435 m.Role = access.Role(role)
436 out = append(out, m)
437 }
438 if err := rows.Err(); err != nil {
439 return nil, err
440 }
441 prows, err := s.db.QueryContext(ctx, `SELECT username, role FROM pending_members WHERE scope_kind = ? AND scope_id = ? ORDER BY username`, scopeKind, scopeID)
442 if err != nil {
443 return nil, err
444 }
445 defer prows.Close()
446 for prows.Next() {
447 var m Member
448 var role string
449 if err := prows.Scan(&m.Username, &role); err != nil {
450 return nil, err
451 }
452 m.Role = access.Role(role)
453 m.Pending = true
454 out = append(out, m)
455 }
456 return out, prows.Err()
457 }
458
459 // ProtectedPatterns geeft de beschermde branchpatronen.
460 func (s *Store) ProtectedPatterns(ctx context.Context, repoID int64) ([]string, error) {
461 rows, err := s.db.QueryContext(ctx, `SELECT pattern FROM protected_branches WHERE repo_id = ? ORDER BY pattern`, repoID)
462 if err != nil {
463 return nil, err
464 }
465 defer rows.Close()
466 var out []string
467 for rows.Next() {
468 var p string
469 if err := rows.Scan(&p); err != nil {
470 return nil, err
471 }
472 out = append(out, p)
473 }
474 return out, rows.Err()
475 }
476
477 // AddProtected voegt een patroon toe.
478 func (s *Store) AddProtected(ctx context.Context, repoID int64, pattern string) error {
479 pattern = strings.TrimSpace(pattern)
480 if pattern == "" || strings.Contains(pattern, " ") || strings.Contains(pattern, "..") {
481 return fmt.Errorf("patroon %q is niet bruikbaar", pattern)
482 }
483 _, err := s.db.ExecContext(ctx, `INSERT INTO protected_branches (repo_id, pattern) VALUES (?, ?)`, repoID, pattern)
484 if err != nil && strings.Contains(err.Error(), "UNIQUE") {
485 return nil
486 }
487 return err
488 }
489
490 // RemoveProtected haalt een patroon weg.
491 func (s *Store) RemoveProtected(ctx context.Context, repoID int64, pattern string) error {
492 _, err := s.db.ExecContext(ctx, `DELETE FROM protected_branches WHERE repo_id = ? AND pattern = ?`, repoID, pattern)
493 return err
494 }
495
496 // SecretMeta is een geheim zonder de waarde.
497 type SecretMeta struct {
498 Name string
499 Protected bool
500 CreatedAt time.Time
501 }
502
503 // PutSecret bewaart een versleutelde waarde. De naam is een omgevingsvariabele.
504 func (s *Store) PutSecret(ctx context.Context, scopeKind string, scopeID int64, name, value string, protected bool) error {
505 if scopeKind != "repo" && scopeKind != "group" {
506 return fmt.Errorf("scope moet repo of group zijn")
507 }
508 if err := access.ValidSecretName(name); err != nil {
509 return err
510 }
511 if strings.TrimSpace(value) == "" {
512 return fmt.Errorf("de waarde is leeg")
513 }
514 nonce, ct, err := s.encrypt(value)
515 if err != nil {
516 return err
517 }
518 _, err = s.db.ExecContext(ctx, `INSERT INTO secrets (scope_kind, scope_id, name, ciphertext, nonce, protected, created_at) VALUES (?, ?, ?, ?, ?, ?, ?)
519 ON CONFLICT(scope_kind, scope_id, name) DO UPDATE SET ciphertext = excluded.ciphertext, nonce = excluded.nonce, protected = excluded.protected`,
520 scopeKind, scopeID, name, ct, nonce, boolInt(protected), now())
521 return err
522 }
523
524 // DeleteSecret verwijdert een geheim.
525 func (s *Store) DeleteSecret(ctx context.Context, scopeKind string, scopeID int64, name string) error {
526 _, err := s.db.ExecContext(ctx, `DELETE FROM secrets WHERE scope_kind = ? AND scope_id = ? AND name = ?`, scopeKind, scopeID, name)
527 return err
528 }
529
530 // ListSecrets geeft namen, niet de waarden.
531 func (s *Store) ListSecrets(ctx context.Context, scopeKind string, scopeID int64) ([]SecretMeta, error) {
532 rows, err := s.db.QueryContext(ctx, `SELECT name, protected, created_at FROM secrets WHERE scope_kind = ? AND scope_id = ? ORDER BY name`, scopeKind, scopeID)
533 if err != nil {
534 return nil, err
535 }
536 defer rows.Close()
537 var out []SecretMeta
538 for rows.Next() {
539 var m SecretMeta
540 var p int
541 var created string
542 if err := rows.Scan(&m.Name, &p, &created); err != nil {
543 return nil, err
544 }
545 m.Protected = p == 1
546 m.CreatedAt = parseTime(created)
547 out = append(out, m)
548 }
549 return out, rows.Err()
550 }
551
552 // SecretValues ontcijfert geheimen voor een job of webhook.
553 // refProtected bepaalt of beschermde geheimen meegaan.
554 func (s *Store) SecretValues(ctx context.Context, scopeKind string, scopeID int64, refProtected bool) (map[string]string, error) {
555 rows, err := s.db.QueryContext(ctx, `SELECT name, ciphertext, nonce, protected FROM secrets WHERE scope_kind = ? AND scope_id = ?`, scopeKind, scopeID)
556 if err != nil {
557 return nil, err
558 }
559 defer rows.Close()
560 out := map[string]string{}
561 for rows.Next() {
562 var name string
563 var ct, nonce []byte
564 var p int
565 if err := rows.Scan(&name, &ct, &nonce, &p); err != nil {
566 return nil, err
567 }
568 if !access.InjectSecret(p == 1, refProtected) {
569 continue
570 }
571 val, err := s.decrypt(nonce, ct)
572 if err != nil {
573 return nil, err
574 }
575 out[name] = val
576 }
577 return out, rows.Err()
578 }
@@ -0,0 +1,578 @@
1package store
2
3import (
4 "context"
5 "database/sql"
6 "errors"
7 "fmt"
8 "strings"
9 "time"
10
11 "gitlab.com/Timfa/bluegit/internal/access"
12 "gitlab.com/Timfa/bluegit/internal/names"
13)
14
15// Group is een verzameling repositories en leden.
16type Group struct {
17 ID int64
18 Name string
19 Path string
20 Description string
21 CreatedBy int64
22 CreatedAt time.Time
23}
24
25// Repo is een git-repository van een gebruiker of een groep.
26type Repo struct {
27 ID int64
28 OwnerKind string
29 OwnerID int64
30 OwnerPath string
31 Name string
32 Description string
33 DefaultBranch string
34 Visibility string
35 CreatedAt time.Time
36}
37
38// FullPath is owner/naam.
39func (r Repo) FullPath() string { return r.OwnerPath + "/" + r.Name }
40
41// CreateGroup maakt een groep. De maker wordt beheerder.
42func (s *Store) CreateGroup(ctx context.Context, creator int64, name, path, description string) (Group, error) {
43 name = strings.TrimSpace(name)
44 path = strings.ToLower(strings.TrimSpace(path))
45 if name == "" {
46 return Group{}, fmt.Errorf("de groep heeft een naam nodig")
47 }
48 if err := names.ValidGroupPath(path); err != nil {
49 return Group{}, err
50 }
51 if err := s.ensurePathFree(ctx, path); err != nil {
52 return Group{}, err
53 }
54 res, err := s.db.ExecContext(ctx, `INSERT INTO groups (name, path, description, created_by, created_at) VALUES (?, ?, ?, ?, ?)`,
55 name, path, strings.TrimSpace(description), creator, now())
56 if err != nil {
57 return Group{}, err
58 }
59 id, _ := res.LastInsertId()
60 if _, err := s.db.ExecContext(ctx, `INSERT INTO group_members (group_id, user_id, role) VALUES (?, ?, ?)`, id, creator, string(access.RoleMaintainer)); err != nil {
61 return Group{}, err
62 }
63 return s.GroupByID(ctx, id)
64}
65
66func (s *Store) ensurePathFree(ctx context.Context, path string) error {
67 var n int
68 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ?`, path).Scan(&n); err != nil {
69 return err
70 }
71 if n > 0 {
72 return fmt.Errorf("pad %s is al een gebruiker", path)
73 }
74 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, path).Scan(&n); err != nil {
75 return err
76 }
77 if n > 0 {
78 return fmt.Errorf("pad %s is al een groep", path)
79 }
80 return nil
81}
82
83// GroupByPath leest een groep.
84func (s *Store) GroupByPath(ctx context.Context, path string) (Group, error) {
85 row := s.db.QueryRowContext(ctx, `SELECT id, name, path, description, created_by, created_at FROM groups WHERE path = ?`, path)
86 return scanGroup(row)
87}
88
89// GroupByID leest een groep.
90func (s *Store) GroupByID(ctx context.Context, id int64) (Group, error) {
91 row := s.db.QueryRowContext(ctx, `SELECT id, name, path, description, created_by, created_at FROM groups WHERE id = ?`, id)
92 return scanGroup(row)
93}
94
95func scanGroup(row *sql.Row) (Group, error) {
96 var g Group
97 var created string
98 if err := row.Scan(&g.ID, &g.Name, &g.Path, &g.Description, &g.CreatedBy, &created); err != nil {
99 if errors.Is(err, sql.ErrNoRows) {
100 return Group{}, errNotFound
101 }
102 return Group{}, err
103 }
104 g.CreatedAt = parseTime(created)
105 return g, nil
106}
107
108// GroupRole is de rol van een gebruiker in een groep.
109// Installatiebeheer geeft geen lidmaatschap.
110func (s *Store) GroupRole(ctx context.Context, groupID, userID int64) (access.Role, error) {
111 if userID == 0 {
112 return access.RoleNone, nil
113 }
114 var role string
115 err := s.db.QueryRowContext(ctx, `SELECT role FROM group_members WHERE group_id = ? AND user_id = ?`, groupID, userID).Scan(&role)
116 if errors.Is(err, sql.ErrNoRows) {
117 return access.RoleNone, nil
118 }
119 if err != nil {
120 return access.RoleNone, err
121 }
122 return access.Role(role), nil
123}
124
125// ListGroups geeft de groepen waarvan deze gebruiker lid is.
126func (s *Store) ListGroups(ctx context.Context, userID int64) ([]Group, error) {
127 q := `SELECT id, name, path, description, created_by, created_at FROM groups WHERE id IN (SELECT group_id FROM group_members WHERE user_id = ?) ORDER BY path`
128 args := []any{userID}
129 rows, err := s.db.QueryContext(ctx, q, args...)
130 if err != nil {
131 return nil, err
132 }
133 defer rows.Close()
134 var out []Group
135 for rows.Next() {
136 var g Group
137 var created string
138 if err := rows.Scan(&g.ID, &g.Name, &g.Path, &g.Description, &g.CreatedBy, &created); err != nil {
139 return nil, err
140 }
141 g.CreatedAt = parseTime(created)
142 out = append(out, g)
143 }
144 return out, rows.Err()
145}
146
147// CreateRepo maakt de metadata. De schijfmap maakt de aanroeper.
148func (s *Store) CreateRepo(ctx context.Context, ownerKind string, ownerID int64, name, description, defaultBranch, visibility string) (Repo, error) {
149 if ownerKind != "user" && ownerKind != "group" {
150 return Repo{}, fmt.Errorf("eigenaar moet user of group zijn")
151 }
152 if err := names.ValidRepoName(name); err != nil {
153 return Repo{}, err
154 }
155 if visibility != "public" && visibility != "private" {
156 return Repo{}, fmt.Errorf("zichtbaarheid moet public of private zijn")
157 }
158 if defaultBranch == "" {
159 defaultBranch = "master"
160 }
161 if ownerKind == "user" {
162 u, err := s.UserByID(ctx, ownerID)
163 if err != nil {
164 return Repo{}, err
165 }
166 var n int
167 if err := s.db.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, u.Username).Scan(&n); err != nil {
168 return Repo{}, err
169 }
170 if n > 0 {
171 return Repo{}, fmt.Errorf("er bestaat al een groep %s; persoonlijke repositories zijn dan niet bereikbaar", u.Username)
172 }
173 }
174 res, err := s.db.ExecContext(ctx, `INSERT INTO repos (owner_kind, owner_id, name, description, default_branch, visibility, created_at) VALUES (?, ?, ?, ?, ?, ?, ?)`,
175 ownerKind, ownerID, name, strings.TrimSpace(description), defaultBranch, visibility, now())
176 if err != nil {
177 if strings.Contains(err.Error(), "UNIQUE") {
178 return Repo{}, fmt.Errorf("er is al een repository %s", name)
179 }
180 return Repo{}, err
181 }
182 id, _ := res.LastInsertId()
183 return s.RepoByID(ctx, id)
184}
185
186// RepoByID leest een repository.
187func (s *Store) RepoByID(ctx context.Context, id int64) (Repo, error) {
188 row := s.db.QueryRowContext(ctx, repoSelect+` WHERE r.id = ?`, id)
189 return scanRepo(row)
190}
191
192// RepoByPath leest owner/naam.
193func (s *Store) RepoByPath(ctx context.Context, owner, name string) (Repo, error) {
194 row := s.db.QueryRowContext(ctx, repoSelect+`
195 WHERE r.name = ? AND (
196 (r.owner_kind = 'user' AND r.owner_id = (SELECT id FROM users WHERE username = ?))
197 OR (r.owner_kind = 'group' AND r.owner_id = (SELECT id FROM groups WHERE path = ?))
198 )`, name, owner, owner)
199 return scanRepo(row)
200}
201
202const repoSelect = `
203SELECT r.id, r.owner_kind, r.owner_id,
204 CASE r.owner_kind WHEN 'user' THEN (SELECT username FROM users WHERE id = r.owner_id) ELSE (SELECT path FROM groups WHERE id = r.owner_id) END,
205 r.name, r.description, r.default_branch, r.visibility, r.created_at
206FROM repos r`
207
208func scanRepo(row *sql.Row) (Repo, error) {
209 var r Repo
210 var created string
211 var owner sql.NullString
212 if err := row.Scan(&r.ID, &r.OwnerKind, &r.OwnerID, &owner, &r.Name, &r.Description, &r.DefaultBranch, &r.Visibility, &created); err != nil {
213 if errors.Is(err, sql.ErrNoRows) {
214 return Repo{}, errNotFound
215 }
216 return Repo{}, err
217 }
218 r.OwnerPath = owner.String
219 r.CreatedAt = parseTime(created)
220 return r, nil
221}
222
223// UpdateRepo wijzigt beschrijving en zichtbaarheid.
224func (s *Store) UpdateRepo(ctx context.Context, id int64, description, visibility string) error {
225 if visibility != "public" && visibility != "private" {
226 return fmt.Errorf("zichtbaarheid moet public of private zijn")
227 }
228 _, err := s.db.ExecContext(ctx, `UPDATE repos SET description = ?, visibility = ? WHERE id = ?`, strings.TrimSpace(description), visibility, id)
229 return err
230}
231
232// DeleteRepo verwijdert de metadata. Bestanden verwijdert de aanroeper.
233func (s *Store) DeleteRepo(ctx context.Context, id int64) error {
234 _, err := s.db.ExecContext(ctx, `DELETE FROM repos WHERE id = ?`, id)
235 return err
236}
237
238// ListRepoIDs geeft repositories die deze gebruiker mag zien:
239// openbare repositories, eigen repositories, repositories van een groep
240// waarvan hij lid is, en repositories met een rechtstreeks lidmaatschap.
241// Installatiebeheer voegt daar niets aan toe.
242func (s *Store) ListRepoIDs(ctx context.Context, userID int64) ([]int64, error) {
243 q := `SELECT id FROM repos WHERE visibility = 'public'`
244 args := []any{}
245 if userID != 0 {
246 q = `SELECT DISTINCT id FROM repos WHERE visibility = 'public'
247 OR (owner_kind = 'user' AND owner_id = ?)
248 OR (owner_kind = 'group' AND owner_id IN (SELECT group_id FROM group_members WHERE user_id = ?))
249 OR id IN (SELECT repo_id FROM repo_members WHERE user_id = ?)`
250 args = []any{userID, userID, userID}
251 }
252 q += ` ORDER BY id DESC`
253 rows, err := s.db.QueryContext(ctx, q, args...)
254 if err != nil {
255 return nil, err
256 }
257 defer rows.Close()
258 var ids []int64
259 for rows.Next() {
260 var id int64
261 if err := rows.Scan(&id); err != nil {
262 return nil, err
263 }
264 ids = append(ids, id)
265 }
266 return ids, rows.Err()
267}
268
269// ReposByGroup geeft de repositories van een groep.
270func (s *Store) ReposByGroup(ctx context.Context, groupID int64) ([]Repo, error) {
271 rows, err := s.db.QueryContext(ctx, repoSelect+` WHERE r.owner_kind = 'group' AND r.owner_id = ? ORDER BY r.name`, groupID)
272 if err != nil {
273 return nil, err
274 }
275 defer rows.Close()
276 return scanRepos(rows)
277}
278
279// ReposByIDs laadt een lijst.
280func (s *Store) ReposByIDs(ctx context.Context, ids []int64) ([]Repo, error) {
281 var out []Repo
282 for _, id := range ids {
283 r, err := s.RepoByID(ctx, id)
284 if err != nil {
285 return nil, err
286 }
287 out = append(out, r)
288 }
289 return out, nil
290}
291
292func scanRepos(rows *sql.Rows) ([]Repo, error) {
293 var out []Repo
294 for rows.Next() {
295 var r Repo
296 var created string
297 var owner sql.NullString
298 if err := rows.Scan(&r.ID, &r.OwnerKind, &r.OwnerID, &owner, &r.Name, &r.Description, &r.DefaultBranch, &r.Visibility, &created); err != nil {
299 return nil, err
300 }
301 r.OwnerPath = owner.String
302 r.CreatedAt = parseTime(created)
303 out = append(out, r)
304 }
305 return out, rows.Err()
306}
307
308// AllRepos is voor het verversen van hooks bij het starten.
309func (s *Store) AllRepos(ctx context.Context) ([]Repo, error) {
310 rows, err := s.db.QueryContext(ctx, repoSelect+` ORDER BY r.id`)
311 if err != nil {
312 return nil, err
313 }
314 defer rows.Close()
315 return scanRepos(rows)
316}
317
318// EffectiveRole past de rolregels toe op een repository.
319func (s *Store) EffectiveRole(ctx context.Context, userID, repoID int64) (access.Role, error) {
320 if userID == 0 {
321 return access.RoleNone, nil
322 }
323 if _, err := s.UserByID(ctx, userID); err != nil {
324 return access.RoleNone, err
325 }
326 repo, err := s.RepoByID(ctx, repoID)
327 if err != nil {
328 return access.RoleNone, err
329 }
330 in := access.Input{}
331 if repo.OwnerKind == "user" && repo.OwnerID == userID {
332 in.UserOwner = true
333 }
334 if repo.OwnerKind == "group" {
335 var role string
336 err := s.db.QueryRowContext(ctx, `SELECT role FROM group_members WHERE group_id = ? AND user_id = ?`, repo.OwnerID, userID).Scan(&role)
337 if err != nil && !errors.Is(err, sql.ErrNoRows) {
338 return access.RoleNone, err
339 }
340 if err == nil {
341 in.GroupRole = access.Role(role)
342 }
343 }
344 var role string
345 err = s.db.QueryRowContext(ctx, `SELECT role FROM repo_members WHERE repo_id = ? AND user_id = ?`, repoID, userID).Scan(&role)
346 if err != nil && !errors.Is(err, sql.ErrNoRows) {
347 return access.RoleNone, err
348 }
349 if err == nil {
350 in.RepoRole = access.Role(role)
351 }
352 return access.Resolve(in), nil
353}
354
355// Member is een lid of een uitnodiging op gebruikersnaam.
356type Member struct {
357 UserID int64
358 Username string
359 Role access.Role
360 Pending bool
361}
362
363// SetMember zet een lidmaatschap. Een onbekende naam blijft wachten tot de eerste login.
364func (s *Store) SetMember(ctx context.Context, scopeKind string, scopeID int64, username string, role access.Role) error {
365 if scopeKind != "repo" && scopeKind != "group" {
366 return fmt.Errorf("scope moet repo of group zijn")
367 }
368 if _, err := access.ParseRole(string(role)); err != nil {
369 return err
370 }
371 username = strings.ToLower(strings.TrimSpace(username))
372 if err := names.ValidUsername(username); err != nil {
373 return err
374 }
375 u, err := s.UserByUsername(ctx, username)
376 if IsNotFound(err) {
377 _, err = s.db.ExecContext(ctx, `INSERT INTO pending_members (scope_kind, scope_id, username, role) VALUES (?, ?, ?, ?)
378 ON CONFLICT(scope_kind, scope_id, username) DO UPDATE SET role = excluded.role`, scopeKind, scopeID, username, string(role))
379 return err
380 }
381 if err != nil {
382 return err
383 }
384 table, col := "repo_members", "repo_id"
385 if scopeKind == "group" {
386 table, col = "group_members", "group_id"
387 }
388 _, err = s.db.ExecContext(ctx, `INSERT INTO `+table+` (`+col+`, user_id, role) VALUES (?, ?, ?)
389 ON CONFLICT(`+col+`, user_id) DO UPDATE SET role = excluded.role`, scopeID, u.ID, string(role))
390 return err
391}
392
393// RemoveMember haalt een lid of een uitnodiging weg.
394func (s *Store) RemoveMember(ctx context.Context, scopeKind string, scopeID int64, username string) error {
395 username = strings.ToLower(strings.TrimSpace(username))
396 _, err := s.db.ExecContext(ctx, `DELETE FROM pending_members WHERE scope_kind = ? AND scope_id = ? AND username = ?`, scopeKind, scopeID, username)
397 if err != nil {
398 return err
399 }
400 u, err := s.UserByUsername(ctx, username)
401 if IsNotFound(err) {
402 return nil
403 }
404 if err != nil {
405 return err
406 }
407 if scopeKind == "group" {
408 _, err = s.db.ExecContext(ctx, `DELETE FROM group_members WHERE group_id = ? AND user_id = ?`, scopeID, u.ID)
409 return err
410 }
411 _, err = s.db.ExecContext(ctx, `DELETE FROM repo_members WHERE repo_id = ? AND user_id = ?`, scopeID, u.ID)
412 return err
413}
414
415// ListMembers geeft leden van een repository of groep, plus open uitnodigingen.
416func (s *Store) ListMembers(ctx context.Context, scopeKind string, scopeID int64) ([]Member, error) {
417 var q string
418 if scopeKind == "group" {
419 q = `SELECT u.id, u.username, m.role FROM group_members m JOIN users u ON u.id = m.user_id WHERE m.group_id = ? ORDER BY u.username`
420 } else {
421 q = `SELECT u.id, u.username, m.role FROM repo_members m JOIN users u ON u.id = m.user_id WHERE m.repo_id = ? ORDER BY u.username`
422 }
423 rows, err := s.db.QueryContext(ctx, q, scopeID)
424 if err != nil {
425 return nil, err
426 }
427 defer rows.Close()
428 var out []Member
429 for rows.Next() {
430 var m Member
431 var role string
432 if err := rows.Scan(&m.UserID, &m.Username, &role); err != nil {
433 return nil, err
434 }
435 m.Role = access.Role(role)
436 out = append(out, m)
437 }
438 if err := rows.Err(); err != nil {
439 return nil, err
440 }
441 prows, err := s.db.QueryContext(ctx, `SELECT username, role FROM pending_members WHERE scope_kind = ? AND scope_id = ? ORDER BY username`, scopeKind, scopeID)
442 if err != nil {
443 return nil, err
444 }
445 defer prows.Close()
446 for prows.Next() {
447 var m Member
448 var role string
449 if err := prows.Scan(&m.Username, &role); err != nil {
450 return nil, err
451 }
452 m.Role = access.Role(role)
453 m.Pending = true
454 out = append(out, m)
455 }
456 return out, prows.Err()
457}
458
459// ProtectedPatterns geeft de beschermde branchpatronen.
460func (s *Store) ProtectedPatterns(ctx context.Context, repoID int64) ([]string, error) {
461 rows, err := s.db.QueryContext(ctx, `SELECT pattern FROM protected_branches WHERE repo_id = ? ORDER BY pattern`, repoID)
462 if err != nil {
463 return nil, err
464 }
465 defer rows.Close()
466 var out []string
467 for rows.Next() {
468 var p string
469 if err := rows.Scan(&p); err != nil {
470 return nil, err
471 }
472 out = append(out, p)
473 }
474 return out, rows.Err()
475}
476
477// AddProtected voegt een patroon toe.
478func (s *Store) AddProtected(ctx context.Context, repoID int64, pattern string) error {
479 pattern = strings.TrimSpace(pattern)
480 if pattern == "" || strings.Contains(pattern, " ") || strings.Contains(pattern, "..") {
481 return fmt.Errorf("patroon %q is niet bruikbaar", pattern)
482 }
483 _, err := s.db.ExecContext(ctx, `INSERT INTO protected_branches (repo_id, pattern) VALUES (?, ?)`, repoID, pattern)
484 if err != nil && strings.Contains(err.Error(), "UNIQUE") {
485 return nil
486 }
487 return err
488}
489
490// RemoveProtected haalt een patroon weg.
491func (s *Store) RemoveProtected(ctx context.Context, repoID int64, pattern string) error {
492 _, err := s.db.ExecContext(ctx, `DELETE FROM protected_branches WHERE repo_id = ? AND pattern = ?`, repoID, pattern)
493 return err
494}
495
496// SecretMeta is een geheim zonder de waarde.
497type SecretMeta struct {
498 Name string
499 Protected bool
500 CreatedAt time.Time
501}
502
503// PutSecret bewaart een versleutelde waarde. De naam is een omgevingsvariabele.
504func (s *Store) PutSecret(ctx context.Context, scopeKind string, scopeID int64, name, value string, protected bool) error {
505 if scopeKind != "repo" && scopeKind != "group" {
506 return fmt.Errorf("scope moet repo of group zijn")
507 }
508 if err := access.ValidSecretName(name); err != nil {
509 return err
510 }
511 if strings.TrimSpace(value) == "" {
512 return fmt.Errorf("de waarde is leeg")
513 }
514 nonce, ct, err := s.encrypt(value)
515 if err != nil {
516 return err
517 }
518 _, err = s.db.ExecContext(ctx, `INSERT INTO secrets (scope_kind, scope_id, name, ciphertext, nonce, protected, created_at) VALUES (?, ?, ?, ?, ?, ?, ?)
519 ON CONFLICT(scope_kind, scope_id, name) DO UPDATE SET ciphertext = excluded.ciphertext, nonce = excluded.nonce, protected = excluded.protected`,
520 scopeKind, scopeID, name, ct, nonce, boolInt(protected), now())
521 return err
522}
523
524// DeleteSecret verwijdert een geheim.
525func (s *Store) DeleteSecret(ctx context.Context, scopeKind string, scopeID int64, name string) error {
526 _, err := s.db.ExecContext(ctx, `DELETE FROM secrets WHERE scope_kind = ? AND scope_id = ? AND name = ?`, scopeKind, scopeID, name)
527 return err
528}
529
530// ListSecrets geeft namen, niet de waarden.
531func (s *Store) ListSecrets(ctx context.Context, scopeKind string, scopeID int64) ([]SecretMeta, error) {
532 rows, err := s.db.QueryContext(ctx, `SELECT name, protected, created_at FROM secrets WHERE scope_kind = ? AND scope_id = ? ORDER BY name`, scopeKind, scopeID)
533 if err != nil {
534 return nil, err
535 }
536 defer rows.Close()
537 var out []SecretMeta
538 for rows.Next() {
539 var m SecretMeta
540 var p int
541 var created string
542 if err := rows.Scan(&m.Name, &p, &created); err != nil {
543 return nil, err
544 }
545 m.Protected = p == 1
546 m.CreatedAt = parseTime(created)
547 out = append(out, m)
548 }
549 return out, rows.Err()
550}
551
552// SecretValues ontcijfert geheimen voor een job of webhook.
553// refProtected bepaalt of beschermde geheimen meegaan.
554func (s *Store) SecretValues(ctx context.Context, scopeKind string, scopeID int64, refProtected bool) (map[string]string, error) {
555 rows, err := s.db.QueryContext(ctx, `SELECT name, ciphertext, nonce, protected FROM secrets WHERE scope_kind = ? AND scope_id = ?`, scopeKind, scopeID)
556 if err != nil {
557 return nil, err
558 }
559 defer rows.Close()
560 out := map[string]string{}
561 for rows.Next() {
562 var name string
563 var ct, nonce []byte
564 var p int
565 if err := rows.Scan(&name, &ct, &nonce, &p); err != nil {
566 return nil, err
567 }
568 if !access.InjectSecret(p == 1, refProtected) {
569 continue
570 }
571 val, err := s.decrypt(nonce, ct)
572 if err != nil {
573 return nil, err
574 }
575 out[name] = val
576 }
577 return out, rows.Err()
578}
internal/store/role_test.go added +174 −0
@@ -0,0 +1,174 @@
1 package store
2
3 import (
4 "context"
5 "path/filepath"
6 "testing"
7
8 "gitlab.com/Timfa/bluegit/internal/access"
9 )
10
11 func TestRolesSecretsAndPending(t *testing.T) {
12 s := openTest(t)
13 ctx := context.Background()
14 tim, err := s.UpsertUser(ctx, 1, "Tim", "", true)
15 if err != nil {
16 t.Fatal(err)
17 }
18 if tim.Username != "tim" || !tim.InstanceAdmin {
19 t.Fatalf("eerste gebruiker: %+v", tim)
20 }
21 ada, err := s.UpsertUser(ctx, 2, "ada", "", false)
22 if err != nil {
23 t.Fatal(err)
24 }
25 if ada.InstanceAdmin {
26 t.Fatal("tweede gebruiker is geen installatiebeheerder")
27 }
28 authAdmin, err := s.UpsertUser(ctx, 9, "authadmin", "", true)
29 if err != nil {
30 t.Fatal(err)
31 }
32 if authAdmin.InstanceAdmin || !authAdmin.AuthAdmin {
33 t.Fatalf("is_admin van de auth-server geeft geen BlueGit-beheer: %+v", authAdmin)
34 }
35 repo, err := s.CreateRepo(ctx, "user", tim.ID, "bluegit", "zelf", "main", "private")
36 if err != nil {
37 t.Fatal(err)
38 }
39 role, err := s.EffectiveRole(ctx, tim.ID, repo.ID)
40 if err != nil || role != access.RoleMaintainer {
41 t.Fatalf("eigenaar %s %v", role, err)
42 }
43 if err := s.SetMember(ctx, "repo", repo.ID, "ada", access.RoleReadonly); err != nil {
44 t.Fatal(err)
45 }
46 role, err = s.EffectiveRole(ctx, ada.ID, repo.ID)
47 if err != nil || role != access.RoleReadonly {
48 t.Fatalf("rechtstreeks %s", role)
49 }
50 if err := s.SetMember(ctx, "repo", repo.ID, "ada", access.RoleDeveloper); err != nil {
51 t.Fatal(err)
52 }
53 role, _ = s.EffectiveRole(ctx, ada.ID, repo.ID)
54 if role != access.RoleDeveloper {
55 t.Fatalf("bijgewerkt %s", role)
56 }
57 group, err := s.CreateGroup(ctx, tim.ID, "Werk", "werk", "")
58 if err != nil {
59 t.Fatal(err)
60 }
61 if _, err := s.CreateGroup(ctx, tim.ID, "Tim", "tim", ""); err == nil {
62 t.Fatal("groep mag niet botsen met een gebruiker")
63 }
64 grown, err := s.CreateRepo(ctx, "group", group.ID, "site", "", "main", "private")
65 if err != nil {
66 t.Fatal(err)
67 }
68 if err := s.SetMember(ctx, "group", group.ID, "ada", access.RoleReadonly); err != nil {
69 t.Fatal(err)
70 }
71 if err := s.SetMember(ctx, "repo", grown.ID, "ada", access.RoleDeveloper); err != nil {
72 t.Fatal(err)
73 }
74 role, _ = s.EffectiveRole(ctx, ada.ID, grown.ID)
75 if role != access.RoleDeveloper {
76 t.Fatalf("hoogste van groep en repo: %s", role)
77 }
78 if err := s.SetMember(ctx, "repo", repo.ID, "nieuweling", access.RoleReadonly); err != nil {
79 t.Fatal(err)
80 }
81 newbie, err := s.UpsertUser(ctx, 3, "nieuweling", "", false)
82 if err != nil {
83 t.Fatal(err)
84 }
85 role, _ = s.EffectiveRole(ctx, newbie.ID, repo.ID)
86 if role != access.RoleReadonly {
87 t.Fatalf("wachtend lid %s", role)
88 }
89 if err := s.PutSecret(ctx, "repo", repo.ID, "DEPLOY_KEY", "geheim", true); err != nil {
90 t.Fatal(err)
91 }
92 open, err := s.SecretValues(ctx, "repo", repo.ID, false)
93 if err != nil {
94 t.Fatal(err)
95 }
96 if _, ok := open["DEPLOY_KEY"]; ok {
97 t.Fatal("beschermd geheim lekt naar een gewone branch")
98 }
99 closed, err := s.SecretValues(ctx, "repo", repo.ID, true)
100 if err != nil || closed["DEPLOY_KEY"] != "geheim" {
101 t.Fatalf("ontcijferen: %v %v", closed, err)
102 }
103 names, err := s.ListSecrets(ctx, "repo", repo.ID)
104 if err != nil || len(names) != 1 || names[0].Name != "DEPLOY_KEY" {
105 t.Fatalf("namen %+v", names)
106 }
107
108 foreign, err := s.CreateRepo(ctx, "user", ada.ID, "geheim", "", "", "private")
109 if err != nil {
110 t.Fatal(err)
111 }
112 if foreign.DefaultBranch != "master" {
113 t.Fatalf("lege standaardbranch werd %s", foreign.DefaultBranch)
114 }
115 role, err = s.EffectiveRole(ctx, tim.ID, foreign.ID)
116 if err != nil || role != access.RoleNone {
117 t.Fatalf("installatiebeheerder op andermans repo: %s %v", role, err)
118 }
119 ids, err := s.ListRepoIDs(ctx, tim.ID)
120 if err != nil {
121 t.Fatal(err)
122 }
123 for _, id := range ids {
124 if id == foreign.ID {
125 t.Fatal("installatiebeheerder ziet een privérepository van een ander")
126 }
127 }
128 foreignGroup, err := s.CreateGroup(ctx, ada.ID, "Ada", "ada-werk", "")
129 if err != nil {
130 t.Fatal(err)
131 }
132 role, err = s.GroupRole(ctx, foreignGroup.ID, tim.ID)
133 if err != nil || role != access.RoleNone {
134 t.Fatalf("installatiebeheerder in andermans groep: %s %v", role, err)
135 }
136 groups, err := s.ListGroups(ctx, tim.ID)
137 if err != nil {
138 t.Fatal(err)
139 }
140 for _, g := range groups {
141 if g.ID == foreignGroup.ID {
142 t.Fatal("installatiebeheerder ziet andermans groep")
143 }
144 }
145 vals, err := s.SecretValues(ctx, "repo", foreign.ID, true)
146 if err != nil {
147 t.Fatal(err)
148 }
149 if len(vals) != 0 {
150 t.Fatalf("onverwachte geheimen %+v", vals)
151 }
152 if err := s.PutSecret(ctx, "repo", foreign.ID, "TOKEN", "van-ada", false); err != nil {
153 t.Fatal(err)
154 }
155 // De waarde is alleen bereikbaar voor wie de rol heeft. Die rol heeft Tim niet.
156 role, _ = s.EffectiveRole(ctx, tim.ID, foreign.ID)
157 if role.CanManageSecrets() {
158 t.Fatal("installatiebeheerder mag andermans geheim niet beheren")
159 }
160 }
161
162 func openTest(t *testing.T) *Store {
163 t.Helper()
164 key := make([]byte, 32)
165 for i := range key {
166 key[i] = byte(i + 1)
167 }
168 s, err := Open(filepath.Join(t.TempDir(), "bluegit.db"), key)
169 if err != nil {
170 t.Fatal(err)
171 }
172 t.Cleanup(func() { _ = s.Close() })
173 return s
174 }
@@ -0,0 +1,174 @@
1package store
2
3import (
4 "context"
5 "path/filepath"
6 "testing"
7
8 "gitlab.com/Timfa/bluegit/internal/access"
9)
10
11func TestRolesSecretsAndPending(t *testing.T) {
12 s := openTest(t)
13 ctx := context.Background()
14 tim, err := s.UpsertUser(ctx, 1, "Tim", "", true)
15 if err != nil {
16 t.Fatal(err)
17 }
18 if tim.Username != "tim" || !tim.InstanceAdmin {
19 t.Fatalf("eerste gebruiker: %+v", tim)
20 }
21 ada, err := s.UpsertUser(ctx, 2, "ada", "", false)
22 if err != nil {
23 t.Fatal(err)
24 }
25 if ada.InstanceAdmin {
26 t.Fatal("tweede gebruiker is geen installatiebeheerder")
27 }
28 authAdmin, err := s.UpsertUser(ctx, 9, "authadmin", "", true)
29 if err != nil {
30 t.Fatal(err)
31 }
32 if authAdmin.InstanceAdmin || !authAdmin.AuthAdmin {
33 t.Fatalf("is_admin van de auth-server geeft geen BlueGit-beheer: %+v", authAdmin)
34 }
35 repo, err := s.CreateRepo(ctx, "user", tim.ID, "bluegit", "zelf", "main", "private")
36 if err != nil {
37 t.Fatal(err)
38 }
39 role, err := s.EffectiveRole(ctx, tim.ID, repo.ID)
40 if err != nil || role != access.RoleMaintainer {
41 t.Fatalf("eigenaar %s %v", role, err)
42 }
43 if err := s.SetMember(ctx, "repo", repo.ID, "ada", access.RoleReadonly); err != nil {
44 t.Fatal(err)
45 }
46 role, err = s.EffectiveRole(ctx, ada.ID, repo.ID)
47 if err != nil || role != access.RoleReadonly {
48 t.Fatalf("rechtstreeks %s", role)
49 }
50 if err := s.SetMember(ctx, "repo", repo.ID, "ada", access.RoleDeveloper); err != nil {
51 t.Fatal(err)
52 }
53 role, _ = s.EffectiveRole(ctx, ada.ID, repo.ID)
54 if role != access.RoleDeveloper {
55 t.Fatalf("bijgewerkt %s", role)
56 }
57 group, err := s.CreateGroup(ctx, tim.ID, "Werk", "werk", "")
58 if err != nil {
59 t.Fatal(err)
60 }
61 if _, err := s.CreateGroup(ctx, tim.ID, "Tim", "tim", ""); err == nil {
62 t.Fatal("groep mag niet botsen met een gebruiker")
63 }
64 grown, err := s.CreateRepo(ctx, "group", group.ID, "site", "", "main", "private")
65 if err != nil {
66 t.Fatal(err)
67 }
68 if err := s.SetMember(ctx, "group", group.ID, "ada", access.RoleReadonly); err != nil {
69 t.Fatal(err)
70 }
71 if err := s.SetMember(ctx, "repo", grown.ID, "ada", access.RoleDeveloper); err != nil {
72 t.Fatal(err)
73 }
74 role, _ = s.EffectiveRole(ctx, ada.ID, grown.ID)
75 if role != access.RoleDeveloper {
76 t.Fatalf("hoogste van groep en repo: %s", role)
77 }
78 if err := s.SetMember(ctx, "repo", repo.ID, "nieuweling", access.RoleReadonly); err != nil {
79 t.Fatal(err)
80 }
81 newbie, err := s.UpsertUser(ctx, 3, "nieuweling", "", false)
82 if err != nil {
83 t.Fatal(err)
84 }
85 role, _ = s.EffectiveRole(ctx, newbie.ID, repo.ID)
86 if role != access.RoleReadonly {
87 t.Fatalf("wachtend lid %s", role)
88 }
89 if err := s.PutSecret(ctx, "repo", repo.ID, "DEPLOY_KEY", "geheim", true); err != nil {
90 t.Fatal(err)
91 }
92 open, err := s.SecretValues(ctx, "repo", repo.ID, false)
93 if err != nil {
94 t.Fatal(err)
95 }
96 if _, ok := open["DEPLOY_KEY"]; ok {
97 t.Fatal("beschermd geheim lekt naar een gewone branch")
98 }
99 closed, err := s.SecretValues(ctx, "repo", repo.ID, true)
100 if err != nil || closed["DEPLOY_KEY"] != "geheim" {
101 t.Fatalf("ontcijferen: %v %v", closed, err)
102 }
103 names, err := s.ListSecrets(ctx, "repo", repo.ID)
104 if err != nil || len(names) != 1 || names[0].Name != "DEPLOY_KEY" {
105 t.Fatalf("namen %+v", names)
106 }
107
108 foreign, err := s.CreateRepo(ctx, "user", ada.ID, "geheim", "", "", "private")
109 if err != nil {
110 t.Fatal(err)
111 }
112 if foreign.DefaultBranch != "master" {
113 t.Fatalf("lege standaardbranch werd %s", foreign.DefaultBranch)
114 }
115 role, err = s.EffectiveRole(ctx, tim.ID, foreign.ID)
116 if err != nil || role != access.RoleNone {
117 t.Fatalf("installatiebeheerder op andermans repo: %s %v", role, err)
118 }
119 ids, err := s.ListRepoIDs(ctx, tim.ID)
120 if err != nil {
121 t.Fatal(err)
122 }
123 for _, id := range ids {
124 if id == foreign.ID {
125 t.Fatal("installatiebeheerder ziet een privérepository van een ander")
126 }
127 }
128 foreignGroup, err := s.CreateGroup(ctx, ada.ID, "Ada", "ada-werk", "")
129 if err != nil {
130 t.Fatal(err)
131 }
132 role, err = s.GroupRole(ctx, foreignGroup.ID, tim.ID)
133 if err != nil || role != access.RoleNone {
134 t.Fatalf("installatiebeheerder in andermans groep: %s %v", role, err)
135 }
136 groups, err := s.ListGroups(ctx, tim.ID)
137 if err != nil {
138 t.Fatal(err)
139 }
140 for _, g := range groups {
141 if g.ID == foreignGroup.ID {
142 t.Fatal("installatiebeheerder ziet andermans groep")
143 }
144 }
145 vals, err := s.SecretValues(ctx, "repo", foreign.ID, true)
146 if err != nil {
147 t.Fatal(err)
148 }
149 if len(vals) != 0 {
150 t.Fatalf("onverwachte geheimen %+v", vals)
151 }
152 if err := s.PutSecret(ctx, "repo", foreign.ID, "TOKEN", "van-ada", false); err != nil {
153 t.Fatal(err)
154 }
155 // De waarde is alleen bereikbaar voor wie de rol heeft. Die rol heeft Tim niet.
156 role, _ = s.EffectiveRole(ctx, tim.ID, foreign.ID)
157 if role.CanManageSecrets() {
158 t.Fatal("installatiebeheerder mag andermans geheim niet beheren")
159 }
160}
161
162func openTest(t *testing.T) *Store {
163 t.Helper()
164 key := make([]byte, 32)
165 for i := range key {
166 key[i] = byte(i + 1)
167 }
168 s, err := Open(filepath.Join(t.TempDir(), "bluegit.db"), key)
169 if err != nil {
170 t.Fatal(err)
171 }
172 t.Cleanup(func() { _ = s.Close() })
173 return s
174}
internal/store/store.go added +686 −0
@@ -0,0 +1,686 @@
1 // Package store bewaart BlueGit in één SQLite-bestand op de datadisk.
2 package store
3
4 import (
5 "context"
6 "crypto/rand"
7 "crypto/sha256"
8 "database/sql"
9 "encoding/hex"
10 "encoding/json"
11 "errors"
12 "fmt"
13 "strings"
14 "time"
15
16 "gitlab.com/Timfa/bluegit/internal/names"
17 "gitlab.com/Timfa/bluegit/internal/secretbox"
18
19 _ "modernc.org/sqlite"
20 )
21
22 // Store is de metadata van deze installatie.
23 type Store struct {
24 db *sql.DB
25 key []byte
26 }
27
28 // Open opent of maakt het databasebestand. key is 32 bytes voor geheimen.
29 func Open(path string, key []byte) (*Store, error) {
30 if len(key) != 32 {
31 return nil, fmt.Errorf("geheime sleutel moet 32 bytes zijn")
32 }
33 dsn := "file:" + path + "?_pragma=busy_timeout(5000)&_pragma=foreign_keys(1)"
34 db, err := sql.Open("sqlite", dsn)
35 if err != nil {
36 return nil, err
37 }
38 db.SetMaxOpenConns(8)
39 s := &Store{db: db, key: key}
40 if _, err := db.Exec(`PRAGMA journal_mode=WAL; PRAGMA foreign_keys=ON;`); err != nil {
41 _ = db.Close()
42 return nil, err
43 }
44 if err := s.migrate(); err != nil {
45 _ = db.Close()
46 return nil, err
47 }
48 return s, nil
49 }
50
51 // Close sluit de database.
52 func (s *Store) Close() error { return s.db.Close() }
53
54 func (s *Store) migrate() error {
55 _, err := s.db.Exec(schema)
56 return err
57 }
58
59 const schema = `
60 CREATE TABLE IF NOT EXISTS users (
61 id INTEGER PRIMARY KEY,
62 auth_id INTEGER NOT NULL UNIQUE,
63 username TEXT NOT NULL UNIQUE,
64 avatar_url TEXT NOT NULL DEFAULT '',
65 auth_admin INTEGER NOT NULL DEFAULT 0,
66 instance_admin INTEGER NOT NULL DEFAULT 0,
67 created_at TEXT NOT NULL,
68 updated_at TEXT NOT NULL
69 );
70 CREATE TABLE IF NOT EXISTS sessions (
71 id TEXT PRIMARY KEY,
72 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
73 access_token TEXT NOT NULL,
74 expires_at TEXT NOT NULL,
75 csrf TEXT NOT NULL,
76 created_at TEXT NOT NULL
77 );
78 CREATE TABLE IF NOT EXISTS access_tokens (
79 id INTEGER PRIMARY KEY,
80 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
81 name TEXT NOT NULL,
82 token_hash TEXT NOT NULL UNIQUE,
83 prefix TEXT NOT NULL,
84 created_at TEXT NOT NULL,
85 last_used_at TEXT,
86 expires_at TEXT
87 );
88 CREATE TABLE IF NOT EXISTS ssh_keys (
89 id INTEGER PRIMARY KEY,
90 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
91 name TEXT NOT NULL,
92 public_key TEXT NOT NULL,
93 fingerprint TEXT NOT NULL UNIQUE,
94 created_at TEXT NOT NULL
95 );
96 CREATE TABLE IF NOT EXISTS groups (
97 id INTEGER PRIMARY KEY,
98 name TEXT NOT NULL,
99 path TEXT NOT NULL UNIQUE,
100 description TEXT NOT NULL DEFAULT '',
101 created_by INTEGER NOT NULL,
102 created_at TEXT NOT NULL
103 );
104 CREATE TABLE IF NOT EXISTS group_members (
105 group_id INTEGER NOT NULL REFERENCES groups(id) ON DELETE CASCADE,
106 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
107 role TEXT NOT NULL,
108 PRIMARY KEY (group_id, user_id)
109 );
110 CREATE TABLE IF NOT EXISTS repos (
111 id INTEGER PRIMARY KEY,
112 owner_kind TEXT NOT NULL,
113 owner_id INTEGER NOT NULL,
114 name TEXT NOT NULL,
115 description TEXT NOT NULL DEFAULT '',
116 default_branch TEXT NOT NULL,
117 visibility TEXT NOT NULL DEFAULT 'private',
118 created_at TEXT NOT NULL,
119 UNIQUE(owner_kind, owner_id, name)
120 );
121 CREATE TABLE IF NOT EXISTS repo_members (
122 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
123 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
124 role TEXT NOT NULL,
125 PRIMARY KEY (repo_id, user_id)
126 );
127 CREATE TABLE IF NOT EXISTS pending_members (
128 id INTEGER PRIMARY KEY,
129 scope_kind TEXT NOT NULL,
130 scope_id INTEGER NOT NULL,
131 username TEXT NOT NULL,
132 role TEXT NOT NULL,
133 UNIQUE(scope_kind, scope_id, username)
134 );
135 CREATE TABLE IF NOT EXISTS protected_branches (
136 id INTEGER PRIMARY KEY,
137 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
138 pattern TEXT NOT NULL,
139 UNIQUE(repo_id, pattern)
140 );
141 CREATE TABLE IF NOT EXISTS secrets (
142 id INTEGER PRIMARY KEY,
143 scope_kind TEXT NOT NULL,
144 scope_id INTEGER NOT NULL,
145 name TEXT NOT NULL,
146 ciphertext BLOB NOT NULL,
147 nonce BLOB NOT NULL,
148 protected INTEGER NOT NULL DEFAULT 0,
149 created_at TEXT NOT NULL,
150 UNIQUE(scope_kind, scope_id, name)
151 );
152 CREATE TABLE IF NOT EXISTS webhooks (
153 id INTEGER PRIMARY KEY,
154 scope_kind TEXT NOT NULL,
155 scope_id INTEGER NOT NULL,
156 name TEXT NOT NULL,
157 preset TEXT NOT NULL,
158 url_template TEXT NOT NULL,
159 headers_json TEXT NOT NULL,
160 body_template TEXT NOT NULL,
161 events_json TEXT NOT NULL,
162 branch_filter TEXT NOT NULL DEFAULT '',
163 active INTEGER NOT NULL DEFAULT 1,
164 created_at TEXT NOT NULL
165 );
166 CREATE TABLE IF NOT EXISTS webhook_deliveries (
167 id INTEGER PRIMARY KEY,
168 webhook_id INTEGER NOT NULL REFERENCES webhooks(id) ON DELETE CASCADE,
169 event_type TEXT NOT NULL,
170 status_code INTEGER NOT NULL DEFAULT 0,
171 error TEXT NOT NULL DEFAULT '',
172 created_at TEXT NOT NULL
173 );
174 CREATE TABLE IF NOT EXISTS merge_requests (
175 id INTEGER PRIMARY KEY,
176 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
177 number INTEGER NOT NULL,
178 title TEXT NOT NULL,
179 description TEXT NOT NULL DEFAULT '',
180 source_branch TEXT NOT NULL,
181 target_branch TEXT NOT NULL,
182 author_id INTEGER NOT NULL,
183 status TEXT NOT NULL,
184 created_at TEXT NOT NULL,
185 updated_at TEXT NOT NULL,
186 UNIQUE(repo_id, number)
187 );
188 CREATE TABLE IF NOT EXISTS pipelines (
189 id INTEGER PRIMARY KEY,
190 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
191 commit_sha TEXT NOT NULL,
192 ref TEXT NOT NULL,
193 status TEXT NOT NULL,
194 created_at TEXT NOT NULL,
195 finished_at TEXT
196 );
197 CREATE TABLE IF NOT EXISTS jobs (
198 id INTEGER PRIMARY KEY,
199 pipeline_id INTEGER NOT NULL REFERENCES pipelines(id) ON DELETE CASCADE,
200 repo_id INTEGER NOT NULL,
201 name TEXT NOT NULL,
202 stage TEXT NOT NULL,
203 position INTEGER NOT NULL,
204 status TEXT NOT NULL,
205 image TEXT NOT NULL,
206 script TEXT NOT NULL,
207 needs_json TEXT NOT NULL,
208 needs_set INTEGER NOT NULL,
209 variables_json TEXT NOT NULL,
210 artifact_paths TEXT NOT NULL,
211 artifact_expire_seconds INTEGER NOT NULL DEFAULT 0,
212 allow_failure INTEGER NOT NULL DEFAULT 0,
213 log TEXT NOT NULL DEFAULT '',
214 started_at TEXT,
215 finished_at TEXT,
216 UNIQUE(pipeline_id, name)
217 );
218 CREATE TABLE IF NOT EXISTS artifacts (
219 id INTEGER PRIMARY KEY,
220 job_id INTEGER NOT NULL REFERENCES jobs(id) ON DELETE CASCADE,
221 path TEXT NOT NULL,
222 storage_path TEXT NOT NULL,
223 size INTEGER NOT NULL,
224 expires_at TEXT
225 );
226 CREATE TABLE IF NOT EXISTS job_tokens (
227 job_id INTEGER PRIMARY KEY REFERENCES jobs(id) ON DELETE CASCADE,
228 token_hash TEXT NOT NULL UNIQUE,
229 created_at TEXT NOT NULL
230 );
231 CREATE TABLE IF NOT EXISTS releases (
232 id INTEGER PRIMARY KEY,
233 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
234 tag TEXT NOT NULL,
235 commit_sha TEXT NOT NULL,
236 name TEXT NOT NULL,
237 body TEXT NOT NULL DEFAULT '',
238 author_id INTEGER,
239 job_id INTEGER,
240 created_at TEXT NOT NULL,
241 UNIQUE(repo_id, tag)
242 );
243 CREATE TABLE IF NOT EXISTS release_assets (
244 id INTEGER PRIMARY KEY,
245 release_id INTEGER NOT NULL REFERENCES releases(id) ON DELETE CASCADE,
246 name TEXT NOT NULL,
247 storage_path TEXT NOT NULL,
248 size INTEGER NOT NULL,
249 UNIQUE(release_id, name)
250 );
251 `
252
253 func now() string { return time.Now().UTC().Format(time.RFC3339) }
254
255 func parseTime(s string) time.Time {
256 t, err := time.Parse(time.RFC3339, s)
257 if err != nil {
258 return time.Time{}
259 }
260 return t
261 }
262
263 // User is een ingelogd account van de auth-server.
264 type User struct {
265 ID int64
266 AuthID int64
267 Username string
268 AvatarURL string
269 AuthAdmin bool
270 InstanceAdmin bool
271 CreatedAt time.Time
272 }
273
274 // UpsertUser maakt of ververst een account. De eerste gebruiker wordt
275 // installatiebeheerder. Wachtende lidmaatschappen op deze naam worden gekoppeld.
276 func (s *Store) UpsertUser(ctx context.Context, authID int64, username, avatar string, authAdmin bool) (User, error) {
277 username = strings.ToLower(strings.TrimSpace(username))
278 if err := names.ValidUsername(username); err != nil {
279 return User{}, err
280 }
281 tx, err := s.db.BeginTx(ctx, nil)
282 if err != nil {
283 return User{}, err
284 }
285 defer func() { _ = tx.Rollback() }()
286
287 var count int
288 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users`).Scan(&count); err != nil {
289 return User{}, err
290 }
291 ts := now()
292 var existingID int64
293 err = tx.QueryRowContext(ctx, `SELECT id FROM users WHERE auth_id = ?`, authID).Scan(&existingID)
294 if errors.Is(err, sql.ErrNoRows) {
295 var nameTaken int
296 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ?`, username).Scan(&nameTaken); err != nil {
297 return User{}, err
298 }
299 if nameTaken > 0 {
300 return User{}, fmt.Errorf("gebruikersnaam %s is al in gebruik", username)
301 }
302 admin := 0
303 if count == 0 {
304 admin = 1
305 }
306 res, err := tx.ExecContext(ctx, `INSERT INTO users (auth_id, username, avatar_url, auth_admin, instance_admin, created_at, updated_at) VALUES (?, ?, ?, ?, ?, ?, ?)`,
307 authID, username, avatar, boolInt(authAdmin), admin, ts, ts)
308 if err != nil {
309 return User{}, err
310 }
311 existingID, _ = res.LastInsertId()
312 } else if err != nil {
313 return User{}, err
314 } else {
315 if _, err := tx.ExecContext(ctx, `UPDATE users SET username = ?, avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ? AND username = ?`,
316 username, avatar, boolInt(authAdmin), ts, existingID, username); err != nil {
317 return User{}, err
318 }
319 // Naamwijziging alleen als de nieuwe naam vrij is en gelijk blijft als hij botst.
320 var current string
321 if err := tx.QueryRowContext(ctx, `SELECT username FROM users WHERE id = ?`, existingID).Scan(&current); err != nil {
322 return User{}, err
323 }
324 if current != username {
325 var taken int
326 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ? AND id <> ?`, username, existingID).Scan(&taken); err != nil {
327 return User{}, err
328 }
329 var groupTaken int
330 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, username).Scan(&groupTaken); err != nil {
331 return User{}, err
332 }
333 if taken == 0 && groupTaken == 0 {
334 if _, err := tx.ExecContext(ctx, `UPDATE users SET username = ?, avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ?`,
335 username, avatar, boolInt(authAdmin), ts, existingID); err != nil {
336 return User{}, err
337 }
338 } else if _, err := tx.ExecContext(ctx, `UPDATE users SET avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ?`,
339 avatar, boolInt(authAdmin), ts, existingID); err != nil {
340 return User{}, err
341 }
342 }
343 }
344 if err := claimPending(ctx, tx, existingID, username); err != nil {
345 return User{}, err
346 }
347 if err := tx.Commit(); err != nil {
348 return User{}, err
349 }
350 return s.UserByID(ctx, existingID)
351 }
352
353 func claimPending(ctx context.Context, tx *sql.Tx, userID int64, username string) error {
354 rows, err := tx.QueryContext(ctx, `SELECT id, scope_kind, scope_id, role FROM pending_members WHERE username = ?`, username)
355 if err != nil {
356 return err
357 }
358 defer rows.Close()
359 type pend struct {
360 id, scopeID int64
361 kind, role string
362 }
363 var all []pend
364 for rows.Next() {
365 var p pend
366 if err := rows.Scan(&p.id, &p.kind, &p.scopeID, &p.role); err != nil {
367 return err
368 }
369 all = append(all, p)
370 }
371 if err := rows.Err(); err != nil {
372 return err
373 }
374 for _, p := range all {
375 switch p.kind {
376 case "group":
377 if _, err := tx.ExecContext(ctx, `INSERT OR IGNORE INTO group_members (group_id, user_id, role) VALUES (?, ?, ?)`, p.scopeID, userID, p.role); err != nil {
378 return err
379 }
380 case "repo":
381 if _, err := tx.ExecContext(ctx, `INSERT OR IGNORE INTO repo_members (repo_id, user_id, role) VALUES (?, ?, ?)`, p.scopeID, userID, p.role); err != nil {
382 return err
383 }
384 }
385 if _, err := tx.ExecContext(ctx, `DELETE FROM pending_members WHERE id = ?`, p.id); err != nil {
386 return err
387 }
388 }
389 return nil
390 }
391
392 // UserByID leest één account.
393 func (s *Store) UserByID(ctx context.Context, id int64) (User, error) {
394 row := s.db.QueryRowContext(ctx, `SELECT id, auth_id, username, avatar_url, auth_admin, instance_admin, created_at FROM users WHERE id = ?`, id)
395 return scanUser(row)
396 }
397
398 // UserByUsername leest op naam.
399 func (s *Store) UserByUsername(ctx context.Context, username string) (User, error) {
400 row := s.db.QueryRowContext(ctx, `SELECT id, auth_id, username, avatar_url, auth_admin, instance_admin, created_at FROM users WHERE username = ?`, strings.ToLower(username))
401 return scanUser(row)
402 }
403
404 func scanUser(row *sql.Row) (User, error) {
405 var u User
406 var admin, inst int
407 var created string
408 if err := row.Scan(&u.ID, &u.AuthID, &u.Username, &u.AvatarURL, &admin, &inst, &created); err != nil {
409 if errors.Is(err, sql.ErrNoRows) {
410 return User{}, errNotFound
411 }
412 return User{}, err
413 }
414 u.AuthAdmin = admin == 1
415 u.InstanceAdmin = inst == 1
416 u.CreatedAt = parseTime(created)
417 return u, nil
418 }
419
420 // Session is een browsersessie.
421 type Session struct {
422 ID string
423 UserID int64
424 AccessToken string
425 ExpiresAt time.Time
426 CSRF string
427 User User
428 }
429
430 // CreateSession bewaart het bearer-token van de auth-server.
431 func (s *Store) CreateSession(ctx context.Context, userID int64, accessToken string, expiresAt time.Time) (Session, error) {
432 id, err := randomID()
433 if err != nil {
434 return Session{}, err
435 }
436 csrf, err := randomID()
437 if err != nil {
438 return Session{}, err
439 }
440 _, err = s.db.ExecContext(ctx, `INSERT INTO sessions (id, user_id, access_token, expires_at, csrf, created_at) VALUES (?, ?, ?, ?, ?, ?)`,
441 id, userID, accessToken, expiresAt.UTC().Format(time.RFC3339), csrf, now())
442 if err != nil {
443 return Session{}, err
444 }
445 return s.Session(ctx, id)
446 }
447
448 // Session leest een sessie met de gebruiker.
449 func (s *Store) Session(ctx context.Context, id string) (Session, error) {
450 var sess Session
451 var exp string
452 err := s.db.QueryRowContext(ctx, `SELECT id, user_id, access_token, expires_at, csrf FROM sessions WHERE id = ?`, id).
453 Scan(&sess.ID, &sess.UserID, &sess.AccessToken, &exp, &sess.CSRF)
454 if errors.Is(err, sql.ErrNoRows) {
455 return Session{}, errNotFound
456 }
457 if err != nil {
458 return Session{}, err
459 }
460 sess.ExpiresAt = parseTime(exp)
461 u, err := s.UserByID(ctx, sess.UserID)
462 if err != nil {
463 return Session{}, err
464 }
465 sess.User = u
466 return sess, nil
467 }
468
469 // UpdateSessionExpiry schuift de lokale kopie van de auth-sessie op.
470 func (s *Store) UpdateSessionExpiry(ctx context.Context, id string, expiresAt time.Time) error {
471 _, err := s.db.ExecContext(ctx, `UPDATE sessions SET expires_at = ? WHERE id = ?`, expiresAt.UTC().Format(time.RFC3339), id)
472 return err
473 }
474
475 // DeleteSession verwijdert de lokale sessie.
476 func (s *Store) DeleteSession(ctx context.Context, id string) error {
477 _, err := s.db.ExecContext(ctx, `DELETE FROM sessions WHERE id = ?`, id)
478 return err
479 }
480
481 // TokenInfo is een persoonlijk toegangstoken zonder het geheim.
482 type TokenInfo struct {
483 ID int64
484 Name string
485 Prefix string
486 CreatedAt time.Time
487 LastUsedAt time.Time
488 }
489
490 // CreateToken maakt een bg_-token. De tekst wordt één keer teruggegeven.
491 func (s *Store) CreateToken(ctx context.Context, userID int64, name string) (string, error) {
492 name = strings.TrimSpace(name)
493 if name == "" || len(name) > 80 {
494 return "", fmt.Errorf("geef het token een naam")
495 }
496 plain, err := newToken("bg_")
497 if err != nil {
498 return "", err
499 }
500 _, err = s.db.ExecContext(ctx, `INSERT INTO access_tokens (user_id, name, token_hash, prefix, created_at) VALUES (?, ?, ?, ?, ?)`,
501 userID, name, hashToken(plain), plain[:10], now())
502 if err != nil {
503 return "", err
504 }
505 return plain, nil
506 }
507
508 // ListTokens toont de tokens van een gebruiker.
509 func (s *Store) ListTokens(ctx context.Context, userID int64) ([]TokenInfo, error) {
510 rows, err := s.db.QueryContext(ctx, `SELECT id, name, prefix, created_at, COALESCE(last_used_at, '') FROM access_tokens WHERE user_id = ? ORDER BY id DESC`, userID)
511 if err != nil {
512 return nil, err
513 }
514 defer rows.Close()
515 var out []TokenInfo
516 for rows.Next() {
517 var t TokenInfo
518 var created, used string
519 if err := rows.Scan(&t.ID, &t.Name, &t.Prefix, &created, &used); err != nil {
520 return nil, err
521 }
522 t.CreatedAt = parseTime(created)
523 t.LastUsedAt = parseTime(used)
524 out = append(out, t)
525 }
526 return out, rows.Err()
527 }
528
529 // DeleteToken verwijdert een token van deze gebruiker.
530 func (s *Store) DeleteToken(ctx context.Context, userID, id int64) error {
531 res, err := s.db.ExecContext(ctx, `DELETE FROM access_tokens WHERE id = ? AND user_id = ?`, id, userID)
532 if err != nil {
533 return err
534 }
535 n, _ := res.RowsAffected()
536 if n == 0 {
537 return errNotFound
538 }
539 return nil
540 }
541
542 // UserByToken zoekt de eigenaar van een persoonlijk token.
543 func (s *Store) UserByToken(ctx context.Context, token string) (User, error) {
544 if !strings.HasPrefix(token, "bg_") {
545 return User{}, errNotFound
546 }
547 var userID, tokenID int64
548 err := s.db.QueryRowContext(ctx, `SELECT id, user_id FROM access_tokens WHERE token_hash = ?`, hashToken(token)).Scan(&tokenID, &userID)
549 if errors.Is(err, sql.ErrNoRows) {
550 return User{}, errNotFound
551 }
552 if err != nil {
553 return User{}, err
554 }
555 _, _ = s.db.ExecContext(ctx, `UPDATE access_tokens SET last_used_at = ? WHERE id = ?`, now(), tokenID)
556 return s.UserByID(ctx, userID)
557 }
558
559 // SSHKey is een publieke sleutel voor git-over-SSH.
560 type SSHKey struct {
561 ID int64
562 UserID int64
563 Name string
564 PublicKey string
565 Fingerprint string
566 CreatedAt time.Time
567 }
568
569 // AddSSHKey bewaart één OpenSSH-regel.
570 func (s *Store) AddSSHKey(ctx context.Context, userID int64, name, line, fingerprint string) error {
571 name = strings.TrimSpace(name)
572 if name == "" {
573 name = "sleutel"
574 }
575 _, err := s.db.ExecContext(ctx, `INSERT INTO ssh_keys (user_id, name, public_key, fingerprint, created_at) VALUES (?, ?, ?, ?, ?)`,
576 userID, name, strings.TrimSpace(line), fingerprint, now())
577 if err != nil && strings.Contains(err.Error(), "UNIQUE") {
578 return fmt.Errorf("deze sleutel staat al geregistreerd")
579 }
580 return err
581 }
582
583 // ListSSHKeys toont de sleutels van een gebruiker.
584 func (s *Store) ListSSHKeys(ctx context.Context, userID int64) ([]SSHKey, error) {
585 rows, err := s.db.QueryContext(ctx, `SELECT id, user_id, name, public_key, fingerprint, created_at FROM ssh_keys WHERE user_id = ? ORDER BY id`, userID)
586 if err != nil {
587 return nil, err
588 }
589 defer rows.Close()
590 return scanKeys(rows)
591 }
592
593 // SSHKeyByFingerprint zoekt een sleutel voor de SSH-server.
594 func (s *Store) SSHKeyByFingerprint(ctx context.Context, fingerprint string) (SSHKey, error) {
595 row := s.db.QueryRowContext(ctx, `SELECT id, user_id, name, public_key, fingerprint, created_at FROM ssh_keys WHERE fingerprint = ?`, fingerprint)
596 var k SSHKey
597 var created string
598 if err := row.Scan(&k.ID, &k.UserID, &k.Name, &k.PublicKey, &k.Fingerprint, &created); err != nil {
599 if errors.Is(err, sql.ErrNoRows) {
600 return SSHKey{}, errNotFound
601 }
602 return SSHKey{}, err
603 }
604 k.CreatedAt = parseTime(created)
605 return k, nil
606 }
607
608 // DeleteSSHKey verwijdert een sleutel van deze gebruiker.
609 func (s *Store) DeleteSSHKey(ctx context.Context, userID, id int64) error {
610 res, err := s.db.ExecContext(ctx, `DELETE FROM ssh_keys WHERE id = ? AND user_id = ?`, id, userID)
611 if err != nil {
612 return err
613 }
614 n, _ := res.RowsAffected()
615 if n == 0 {
616 return errNotFound
617 }
618 return nil
619 }
620
621 func scanKeys(rows *sql.Rows) ([]SSHKey, error) {
622 var out []SSHKey
623 for rows.Next() {
624 var k SSHKey
625 var created string
626 if err := rows.Scan(&k.ID, &k.UserID, &k.Name, &k.PublicKey, &k.Fingerprint, &created); err != nil {
627 return nil, err
628 }
629 k.CreatedAt = parseTime(created)
630 out = append(out, k)
631 }
632 return out, rows.Err()
633 }
634
635 func randomID() (string, error) {
636 b := make([]byte, 32)
637 if _, err := rand.Read(b); err != nil {
638 return "", err
639 }
640 return hex.EncodeToString(b), nil
641 }
642
643 func newToken(prefix string) (string, error) {
644 b := make([]byte, 32)
645 if _, err := rand.Read(b); err != nil {
646 return "", err
647 }
648 return prefix + hex.EncodeToString(b), nil
649 }
650
651 func hashToken(token string) string {
652 sum := sha256.Sum256([]byte(token))
653 return hex.EncodeToString(sum[:])
654 }
655
656 func boolInt(b bool) int {
657 if b {
658 return 1
659 }
660 return 0
661 }
662
663 var errNotFound = fmt.Errorf("niet gevonden")
664
665 // ErrNotFound is het resultaat als een rij ontbreekt.
666 func ErrNotFound() error { return errNotFound }
667
668 // IsNotFound meldt of err een ontbrekende rij is.
669 func IsNotFound(err error) bool { return errors.Is(err, errNotFound) }
670
671 func mustJSON(v any) string {
672 b, _ := json.Marshal(v)
673 if b == nil {
674 return "null"
675 }
676 return string(b)
677 }
678
679 // EncryptSecret versleutelt een geheim met de installatiesleutel.
680 func (s *Store) encrypt(plain string) (nonce, ct []byte, err error) {
681 return secretbox.Encrypt(s.key, plain)
682 }
683
684 func (s *Store) decrypt(nonce, ct []byte) (string, error) {
685 return secretbox.Decrypt(s.key, nonce, ct)
686 }
@@ -0,0 +1,686 @@
1// Package store bewaart BlueGit in één SQLite-bestand op de datadisk.
2package store
3
4import (
5 "context"
6 "crypto/rand"
7 "crypto/sha256"
8 "database/sql"
9 "encoding/hex"
10 "encoding/json"
11 "errors"
12 "fmt"
13 "strings"
14 "time"
15
16 "gitlab.com/Timfa/bluegit/internal/names"
17 "gitlab.com/Timfa/bluegit/internal/secretbox"
18
19 _ "modernc.org/sqlite"
20)
21
22// Store is de metadata van deze installatie.
23type Store struct {
24 db *sql.DB
25 key []byte
26}
27
28// Open opent of maakt het databasebestand. key is 32 bytes voor geheimen.
29func Open(path string, key []byte) (*Store, error) {
30 if len(key) != 32 {
31 return nil, fmt.Errorf("geheime sleutel moet 32 bytes zijn")
32 }
33 dsn := "file:" + path + "?_pragma=busy_timeout(5000)&_pragma=foreign_keys(1)"
34 db, err := sql.Open("sqlite", dsn)
35 if err != nil {
36 return nil, err
37 }
38 db.SetMaxOpenConns(8)
39 s := &Store{db: db, key: key}
40 if _, err := db.Exec(`PRAGMA journal_mode=WAL; PRAGMA foreign_keys=ON;`); err != nil {
41 _ = db.Close()
42 return nil, err
43 }
44 if err := s.migrate(); err != nil {
45 _ = db.Close()
46 return nil, err
47 }
48 return s, nil
49}
50
51// Close sluit de database.
52func (s *Store) Close() error { return s.db.Close() }
53
54func (s *Store) migrate() error {
55 _, err := s.db.Exec(schema)
56 return err
57}
58
59const schema = `
60CREATE TABLE IF NOT EXISTS users (
61 id INTEGER PRIMARY KEY,
62 auth_id INTEGER NOT NULL UNIQUE,
63 username TEXT NOT NULL UNIQUE,
64 avatar_url TEXT NOT NULL DEFAULT '',
65 auth_admin INTEGER NOT NULL DEFAULT 0,
66 instance_admin INTEGER NOT NULL DEFAULT 0,
67 created_at TEXT NOT NULL,
68 updated_at TEXT NOT NULL
69);
70CREATE TABLE IF NOT EXISTS sessions (
71 id TEXT PRIMARY KEY,
72 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
73 access_token TEXT NOT NULL,
74 expires_at TEXT NOT NULL,
75 csrf TEXT NOT NULL,
76 created_at TEXT NOT NULL
77);
78CREATE TABLE IF NOT EXISTS access_tokens (
79 id INTEGER PRIMARY KEY,
80 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
81 name TEXT NOT NULL,
82 token_hash TEXT NOT NULL UNIQUE,
83 prefix TEXT NOT NULL,
84 created_at TEXT NOT NULL,
85 last_used_at TEXT,
86 expires_at TEXT
87);
88CREATE TABLE IF NOT EXISTS ssh_keys (
89 id INTEGER PRIMARY KEY,
90 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
91 name TEXT NOT NULL,
92 public_key TEXT NOT NULL,
93 fingerprint TEXT NOT NULL UNIQUE,
94 created_at TEXT NOT NULL
95);
96CREATE TABLE IF NOT EXISTS groups (
97 id INTEGER PRIMARY KEY,
98 name TEXT NOT NULL,
99 path TEXT NOT NULL UNIQUE,
100 description TEXT NOT NULL DEFAULT '',
101 created_by INTEGER NOT NULL,
102 created_at TEXT NOT NULL
103);
104CREATE TABLE IF NOT EXISTS group_members (
105 group_id INTEGER NOT NULL REFERENCES groups(id) ON DELETE CASCADE,
106 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
107 role TEXT NOT NULL,
108 PRIMARY KEY (group_id, user_id)
109);
110CREATE TABLE IF NOT EXISTS repos (
111 id INTEGER PRIMARY KEY,
112 owner_kind TEXT NOT NULL,
113 owner_id INTEGER NOT NULL,
114 name TEXT NOT NULL,
115 description TEXT NOT NULL DEFAULT '',
116 default_branch TEXT NOT NULL,
117 visibility TEXT NOT NULL DEFAULT 'private',
118 created_at TEXT NOT NULL,
119 UNIQUE(owner_kind, owner_id, name)
120);
121CREATE TABLE IF NOT EXISTS repo_members (
122 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
123 user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
124 role TEXT NOT NULL,
125 PRIMARY KEY (repo_id, user_id)
126);
127CREATE TABLE IF NOT EXISTS pending_members (
128 id INTEGER PRIMARY KEY,
129 scope_kind TEXT NOT NULL,
130 scope_id INTEGER NOT NULL,
131 username TEXT NOT NULL,
132 role TEXT NOT NULL,
133 UNIQUE(scope_kind, scope_id, username)
134);
135CREATE TABLE IF NOT EXISTS protected_branches (
136 id INTEGER PRIMARY KEY,
137 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
138 pattern TEXT NOT NULL,
139 UNIQUE(repo_id, pattern)
140);
141CREATE TABLE IF NOT EXISTS secrets (
142 id INTEGER PRIMARY KEY,
143 scope_kind TEXT NOT NULL,
144 scope_id INTEGER NOT NULL,
145 name TEXT NOT NULL,
146 ciphertext BLOB NOT NULL,
147 nonce BLOB NOT NULL,
148 protected INTEGER NOT NULL DEFAULT 0,
149 created_at TEXT NOT NULL,
150 UNIQUE(scope_kind, scope_id, name)
151);
152CREATE TABLE IF NOT EXISTS webhooks (
153 id INTEGER PRIMARY KEY,
154 scope_kind TEXT NOT NULL,
155 scope_id INTEGER NOT NULL,
156 name TEXT NOT NULL,
157 preset TEXT NOT NULL,
158 url_template TEXT NOT NULL,
159 headers_json TEXT NOT NULL,
160 body_template TEXT NOT NULL,
161 events_json TEXT NOT NULL,
162 branch_filter TEXT NOT NULL DEFAULT '',
163 active INTEGER NOT NULL DEFAULT 1,
164 created_at TEXT NOT NULL
165);
166CREATE TABLE IF NOT EXISTS webhook_deliveries (
167 id INTEGER PRIMARY KEY,
168 webhook_id INTEGER NOT NULL REFERENCES webhooks(id) ON DELETE CASCADE,
169 event_type TEXT NOT NULL,
170 status_code INTEGER NOT NULL DEFAULT 0,
171 error TEXT NOT NULL DEFAULT '',
172 created_at TEXT NOT NULL
173);
174CREATE TABLE IF NOT EXISTS merge_requests (
175 id INTEGER PRIMARY KEY,
176 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
177 number INTEGER NOT NULL,
178 title TEXT NOT NULL,
179 description TEXT NOT NULL DEFAULT '',
180 source_branch TEXT NOT NULL,
181 target_branch TEXT NOT NULL,
182 author_id INTEGER NOT NULL,
183 status TEXT NOT NULL,
184 created_at TEXT NOT NULL,
185 updated_at TEXT NOT NULL,
186 UNIQUE(repo_id, number)
187);
188CREATE TABLE IF NOT EXISTS pipelines (
189 id INTEGER PRIMARY KEY,
190 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
191 commit_sha TEXT NOT NULL,
192 ref TEXT NOT NULL,
193 status TEXT NOT NULL,
194 created_at TEXT NOT NULL,
195 finished_at TEXT
196);
197CREATE TABLE IF NOT EXISTS jobs (
198 id INTEGER PRIMARY KEY,
199 pipeline_id INTEGER NOT NULL REFERENCES pipelines(id) ON DELETE CASCADE,
200 repo_id INTEGER NOT NULL,
201 name TEXT NOT NULL,
202 stage TEXT NOT NULL,
203 position INTEGER NOT NULL,
204 status TEXT NOT NULL,
205 image TEXT NOT NULL,
206 script TEXT NOT NULL,
207 needs_json TEXT NOT NULL,
208 needs_set INTEGER NOT NULL,
209 variables_json TEXT NOT NULL,
210 artifact_paths TEXT NOT NULL,
211 artifact_expire_seconds INTEGER NOT NULL DEFAULT 0,
212 allow_failure INTEGER NOT NULL DEFAULT 0,
213 log TEXT NOT NULL DEFAULT '',
214 started_at TEXT,
215 finished_at TEXT,
216 UNIQUE(pipeline_id, name)
217);
218CREATE TABLE IF NOT EXISTS artifacts (
219 id INTEGER PRIMARY KEY,
220 job_id INTEGER NOT NULL REFERENCES jobs(id) ON DELETE CASCADE,
221 path TEXT NOT NULL,
222 storage_path TEXT NOT NULL,
223 size INTEGER NOT NULL,
224 expires_at TEXT
225);
226CREATE TABLE IF NOT EXISTS job_tokens (
227 job_id INTEGER PRIMARY KEY REFERENCES jobs(id) ON DELETE CASCADE,
228 token_hash TEXT NOT NULL UNIQUE,
229 created_at TEXT NOT NULL
230);
231CREATE TABLE IF NOT EXISTS releases (
232 id INTEGER PRIMARY KEY,
233 repo_id INTEGER NOT NULL REFERENCES repos(id) ON DELETE CASCADE,
234 tag TEXT NOT NULL,
235 commit_sha TEXT NOT NULL,
236 name TEXT NOT NULL,
237 body TEXT NOT NULL DEFAULT '',
238 author_id INTEGER,
239 job_id INTEGER,
240 created_at TEXT NOT NULL,
241 UNIQUE(repo_id, tag)
242);
243CREATE TABLE IF NOT EXISTS release_assets (
244 id INTEGER PRIMARY KEY,
245 release_id INTEGER NOT NULL REFERENCES releases(id) ON DELETE CASCADE,
246 name TEXT NOT NULL,
247 storage_path TEXT NOT NULL,
248 size INTEGER NOT NULL,
249 UNIQUE(release_id, name)
250);
251`
252
253func now() string { return time.Now().UTC().Format(time.RFC3339) }
254
255func parseTime(s string) time.Time {
256 t, err := time.Parse(time.RFC3339, s)
257 if err != nil {
258 return time.Time{}
259 }
260 return t
261}
262
263// User is een ingelogd account van de auth-server.
264type User struct {
265 ID int64
266 AuthID int64
267 Username string
268 AvatarURL string
269 AuthAdmin bool
270 InstanceAdmin bool
271 CreatedAt time.Time
272}
273
274// UpsertUser maakt of ververst een account. De eerste gebruiker wordt
275// installatiebeheerder. Wachtende lidmaatschappen op deze naam worden gekoppeld.
276func (s *Store) UpsertUser(ctx context.Context, authID int64, username, avatar string, authAdmin bool) (User, error) {
277 username = strings.ToLower(strings.TrimSpace(username))
278 if err := names.ValidUsername(username); err != nil {
279 return User{}, err
280 }
281 tx, err := s.db.BeginTx(ctx, nil)
282 if err != nil {
283 return User{}, err
284 }
285 defer func() { _ = tx.Rollback() }()
286
287 var count int
288 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users`).Scan(&count); err != nil {
289 return User{}, err
290 }
291 ts := now()
292 var existingID int64
293 err = tx.QueryRowContext(ctx, `SELECT id FROM users WHERE auth_id = ?`, authID).Scan(&existingID)
294 if errors.Is(err, sql.ErrNoRows) {
295 var nameTaken int
296 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ?`, username).Scan(&nameTaken); err != nil {
297 return User{}, err
298 }
299 if nameTaken > 0 {
300 return User{}, fmt.Errorf("gebruikersnaam %s is al in gebruik", username)
301 }
302 admin := 0
303 if count == 0 {
304 admin = 1
305 }
306 res, err := tx.ExecContext(ctx, `INSERT INTO users (auth_id, username, avatar_url, auth_admin, instance_admin, created_at, updated_at) VALUES (?, ?, ?, ?, ?, ?, ?)`,
307 authID, username, avatar, boolInt(authAdmin), admin, ts, ts)
308 if err != nil {
309 return User{}, err
310 }
311 existingID, _ = res.LastInsertId()
312 } else if err != nil {
313 return User{}, err
314 } else {
315 if _, err := tx.ExecContext(ctx, `UPDATE users SET username = ?, avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ? AND username = ?`,
316 username, avatar, boolInt(authAdmin), ts, existingID, username); err != nil {
317 return User{}, err
318 }
319 // Naamwijziging alleen als de nieuwe naam vrij is en gelijk blijft als hij botst.
320 var current string
321 if err := tx.QueryRowContext(ctx, `SELECT username FROM users WHERE id = ?`, existingID).Scan(&current); err != nil {
322 return User{}, err
323 }
324 if current != username {
325 var taken int
326 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM users WHERE username = ? AND id <> ?`, username, existingID).Scan(&taken); err != nil {
327 return User{}, err
328 }
329 var groupTaken int
330 if err := tx.QueryRowContext(ctx, `SELECT COUNT(*) FROM groups WHERE path = ?`, username).Scan(&groupTaken); err != nil {
331 return User{}, err
332 }
333 if taken == 0 && groupTaken == 0 {
334 if _, err := tx.ExecContext(ctx, `UPDATE users SET username = ?, avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ?`,
335 username, avatar, boolInt(authAdmin), ts, existingID); err != nil {
336 return User{}, err
337 }
338 } else if _, err := tx.ExecContext(ctx, `UPDATE users SET avatar_url = ?, auth_admin = ?, updated_at = ? WHERE id = ?`,
339 avatar, boolInt(authAdmin), ts, existingID); err != nil {
340 return User{}, err
341 }
342 }
343 }
344 if err := claimPending(ctx, tx, existingID, username); err != nil {
345 return User{}, err
346 }
347 if err := tx.Commit(); err != nil {
348 return User{}, err
349 }
350 return s.UserByID(ctx, existingID)
351}
352
353func claimPending(ctx context.Context, tx *sql.Tx, userID int64, username string) error {
354 rows, err := tx.QueryContext(ctx, `SELECT id, scope_kind, scope_id, role FROM pending_members WHERE username = ?`, username)
355 if err != nil {
356 return err
357 }
358 defer rows.Close()
359 type pend struct {
360 id, scopeID int64
361 kind, role string
362 }
363 var all []pend
364 for rows.Next() {
365 var p pend
366 if err := rows.Scan(&p.id, &p.kind, &p.scopeID, &p.role); err != nil {
367 return err
368 }
369 all = append(all, p)
370 }
371 if err := rows.Err(); err != nil {
372 return err
373 }
374 for _, p := range all {
375 switch p.kind {
376 case "group":
377 if _, err := tx.ExecContext(ctx, `INSERT OR IGNORE INTO group_members (group_id, user_id, role) VALUES (?, ?, ?)`, p.scopeID, userID, p.role); err != nil {
378 return err
379 }
380 case "repo":
381 if _, err := tx.ExecContext(ctx, `INSERT OR IGNORE INTO repo_members (repo_id, user_id, role) VALUES (?, ?, ?)`, p.scopeID, userID, p.role); err != nil {
382 return err
383 }
384 }
385 if _, err := tx.ExecContext(ctx, `DELETE FROM pending_members WHERE id = ?`, p.id); err != nil {
386 return err
387 }
388 }
389 return nil
390}
391
392// UserByID leest één account.
393func (s *Store) UserByID(ctx context.Context, id int64) (User, error) {
394 row := s.db.QueryRowContext(ctx, `SELECT id, auth_id, username, avatar_url, auth_admin, instance_admin, created_at FROM users WHERE id = ?`, id)
395 return scanUser(row)
396}
397
398// UserByUsername leest op naam.
399func (s *Store) UserByUsername(ctx context.Context, username string) (User, error) {
400 row := s.db.QueryRowContext(ctx, `SELECT id, auth_id, username, avatar_url, auth_admin, instance_admin, created_at FROM users WHERE username = ?`, strings.ToLower(username))
401 return scanUser(row)
402}
403
404func scanUser(row *sql.Row) (User, error) {
405 var u User
406 var admin, inst int
407 var created string
408 if err := row.Scan(&u.ID, &u.AuthID, &u.Username, &u.AvatarURL, &admin, &inst, &created); err != nil {
409 if errors.Is(err, sql.ErrNoRows) {
410 return User{}, errNotFound
411 }
412 return User{}, err
413 }
414 u.AuthAdmin = admin == 1
415 u.InstanceAdmin = inst == 1
416 u.CreatedAt = parseTime(created)
417 return u, nil
418}
419
420// Session is een browsersessie.
421type Session struct {
422 ID string
423 UserID int64
424 AccessToken string
425 ExpiresAt time.Time
426 CSRF string
427 User User
428}
429
430// CreateSession bewaart het bearer-token van de auth-server.
431func (s *Store) CreateSession(ctx context.Context, userID int64, accessToken string, expiresAt time.Time) (Session, error) {
432 id, err := randomID()
433 if err != nil {
434 return Session{}, err
435 }
436 csrf, err := randomID()
437 if err != nil {
438 return Session{}, err
439 }
440 _, err = s.db.ExecContext(ctx, `INSERT INTO sessions (id, user_id, access_token, expires_at, csrf, created_at) VALUES (?, ?, ?, ?, ?, ?)`,
441 id, userID, accessToken, expiresAt.UTC().Format(time.RFC3339), csrf, now())
442 if err != nil {
443 return Session{}, err
444 }
445 return s.Session(ctx, id)
446}
447
448// Session leest een sessie met de gebruiker.
449func (s *Store) Session(ctx context.Context, id string) (Session, error) {
450 var sess Session
451 var exp string
452 err := s.db.QueryRowContext(ctx, `SELECT id, user_id, access_token, expires_at, csrf FROM sessions WHERE id = ?`, id).
453 Scan(&sess.ID, &sess.UserID, &sess.AccessToken, &exp, &sess.CSRF)
454 if errors.Is(err, sql.ErrNoRows) {
455 return Session{}, errNotFound
456 }
457 if err != nil {
458 return Session{}, err
459 }
460 sess.ExpiresAt = parseTime(exp)
461 u, err := s.UserByID(ctx, sess.UserID)
462 if err != nil {
463 return Session{}, err
464 }
465 sess.User = u
466 return sess, nil
467}
468
469// UpdateSessionExpiry schuift de lokale kopie van de auth-sessie op.
470func (s *Store) UpdateSessionExpiry(ctx context.Context, id string, expiresAt time.Time) error {
471 _, err := s.db.ExecContext(ctx, `UPDATE sessions SET expires_at = ? WHERE id = ?`, expiresAt.UTC().Format(time.RFC3339), id)
472 return err
473}
474
475// DeleteSession verwijdert de lokale sessie.
476func (s *Store) DeleteSession(ctx context.Context, id string) error {
477 _, err := s.db.ExecContext(ctx, `DELETE FROM sessions WHERE id = ?`, id)
478 return err
479}
480
481// TokenInfo is een persoonlijk toegangstoken zonder het geheim.
482type TokenInfo struct {
483 ID int64
484 Name string
485 Prefix string
486 CreatedAt time.Time
487 LastUsedAt time.Time
488}
489
490// CreateToken maakt een bg_-token. De tekst wordt één keer teruggegeven.
491func (s *Store) CreateToken(ctx context.Context, userID int64, name string) (string, error) {
492 name = strings.TrimSpace(name)
493 if name == "" || len(name) > 80 {
494 return "", fmt.Errorf("geef het token een naam")
495 }
496 plain, err := newToken("bg_")
497 if err != nil {
498 return "", err
499 }
500 _, err = s.db.ExecContext(ctx, `INSERT INTO access_tokens (user_id, name, token_hash, prefix, created_at) VALUES (?, ?, ?, ?, ?)`,
501 userID, name, hashToken(plain), plain[:10], now())
502 if err != nil {
503 return "", err
504 }
505 return plain, nil
506}
507
508// ListTokens toont de tokens van een gebruiker.
509func (s *Store) ListTokens(ctx context.Context, userID int64) ([]TokenInfo, error) {
510 rows, err := s.db.QueryContext(ctx, `SELECT id, name, prefix, created_at, COALESCE(last_used_at, '') FROM access_tokens WHERE user_id = ? ORDER BY id DESC`, userID)
511 if err != nil {
512 return nil, err
513 }
514 defer rows.Close()
515 var out []TokenInfo
516 for rows.Next() {
517 var t TokenInfo
518 var created, used string
519 if err := rows.Scan(&t.ID, &t.Name, &t.Prefix, &created, &used); err != nil {
520 return nil, err
521 }
522 t.CreatedAt = parseTime(created)
523 t.LastUsedAt = parseTime(used)
524 out = append(out, t)
525 }
526 return out, rows.Err()
527}
528
529// DeleteToken verwijdert een token van deze gebruiker.
530func (s *Store) DeleteToken(ctx context.Context, userID, id int64) error {
531 res, err := s.db.ExecContext(ctx, `DELETE FROM access_tokens WHERE id = ? AND user_id = ?`, id, userID)
532 if err != nil {
533 return err
534 }
535 n, _ := res.RowsAffected()
536 if n == 0 {
537 return errNotFound
538 }
539 return nil
540}
541
542// UserByToken zoekt de eigenaar van een persoonlijk token.
543func (s *Store) UserByToken(ctx context.Context, token string) (User, error) {
544 if !strings.HasPrefix(token, "bg_") {
545 return User{}, errNotFound
546 }
547 var userID, tokenID int64
548 err := s.db.QueryRowContext(ctx, `SELECT id, user_id FROM access_tokens WHERE token_hash = ?`, hashToken(token)).Scan(&tokenID, &userID)
549 if errors.Is(err, sql.ErrNoRows) {
550 return User{}, errNotFound
551 }
552 if err != nil {
553 return User{}, err
554 }
555 _, _ = s.db.ExecContext(ctx, `UPDATE access_tokens SET last_used_at = ? WHERE id = ?`, now(), tokenID)
556 return s.UserByID(ctx, userID)
557}
558
559// SSHKey is een publieke sleutel voor git-over-SSH.
560type SSHKey struct {
561 ID int64
562 UserID int64
563 Name string
564 PublicKey string
565 Fingerprint string
566 CreatedAt time.Time
567}
568
569// AddSSHKey bewaart één OpenSSH-regel.
570func (s *Store) AddSSHKey(ctx context.Context, userID int64, name, line, fingerprint string) error {
571 name = strings.TrimSpace(name)
572 if name == "" {
573 name = "sleutel"
574 }
575 _, err := s.db.ExecContext(ctx, `INSERT INTO ssh_keys (user_id, name, public_key, fingerprint, created_at) VALUES (?, ?, ?, ?, ?)`,
576 userID, name, strings.TrimSpace(line), fingerprint, now())
577 if err != nil && strings.Contains(err.Error(), "UNIQUE") {
578 return fmt.Errorf("deze sleutel staat al geregistreerd")
579 }
580 return err
581}
582
583// ListSSHKeys toont de sleutels van een gebruiker.
584func (s *Store) ListSSHKeys(ctx context.Context, userID int64) ([]SSHKey, error) {
585 rows, err := s.db.QueryContext(ctx, `SELECT id, user_id, name, public_key, fingerprint, created_at FROM ssh_keys WHERE user_id = ? ORDER BY id`, userID)
586 if err != nil {
587 return nil, err
588 }
589 defer rows.Close()
590 return scanKeys(rows)
591}
592
593// SSHKeyByFingerprint zoekt een sleutel voor de SSH-server.
594func (s *Store) SSHKeyByFingerprint(ctx context.Context, fingerprint string) (SSHKey, error) {
595 row := s.db.QueryRowContext(ctx, `SELECT id, user_id, name, public_key, fingerprint, created_at FROM ssh_keys WHERE fingerprint = ?`, fingerprint)
596 var k SSHKey
597 var created string
598 if err := row.Scan(&k.ID, &k.UserID, &k.Name, &k.PublicKey, &k.Fingerprint, &created); err != nil {
599 if errors.Is(err, sql.ErrNoRows) {
600 return SSHKey{}, errNotFound
601 }
602 return SSHKey{}, err
603 }
604 k.CreatedAt = parseTime(created)
605 return k, nil
606}
607
608// DeleteSSHKey verwijdert een sleutel van deze gebruiker.
609func (s *Store) DeleteSSHKey(ctx context.Context, userID, id int64) error {
610 res, err := s.db.ExecContext(ctx, `DELETE FROM ssh_keys WHERE id = ? AND user_id = ?`, id, userID)
611 if err != nil {
612 return err
613 }
614 n, _ := res.RowsAffected()
615 if n == 0 {
616 return errNotFound
617 }
618 return nil
619}
620
621func scanKeys(rows *sql.Rows) ([]SSHKey, error) {
622 var out []SSHKey
623 for rows.Next() {
624 var k SSHKey
625 var created string
626 if err := rows.Scan(&k.ID, &k.UserID, &k.Name, &k.PublicKey, &k.Fingerprint, &created); err != nil {
627 return nil, err
628 }
629 k.CreatedAt = parseTime(created)
630 out = append(out, k)
631 }
632 return out, rows.Err()
633}
634
635func randomID() (string, error) {
636 b := make([]byte, 32)
637 if _, err := rand.Read(b); err != nil {
638 return "", err
639 }
640 return hex.EncodeToString(b), nil
641}
642
643func newToken(prefix string) (string, error) {
644 b := make([]byte, 32)
645 if _, err := rand.Read(b); err != nil {
646 return "", err
647 }
648 return prefix + hex.EncodeToString(b), nil
649}
650
651func hashToken(token string) string {
652 sum := sha256.Sum256([]byte(token))
653 return hex.EncodeToString(sum[:])
654}
655
656func boolInt(b bool) int {
657 if b {
658 return 1
659 }
660 return 0
661}
662
663var errNotFound = fmt.Errorf("niet gevonden")
664
665// ErrNotFound is het resultaat als een rij ontbreekt.
666func ErrNotFound() error { return errNotFound }
667
668// IsNotFound meldt of err een ontbrekende rij is.
669func IsNotFound(err error) bool { return errors.Is(err, errNotFound) }
670
671func mustJSON(v any) string {
672 b, _ := json.Marshal(v)
673 if b == nil {
674 return "null"
675 }
676 return string(b)
677}
678
679// EncryptSecret versleutelt een geheim met de installatiesleutel.
680func (s *Store) encrypt(plain string) (nonce, ct []byte, err error) {
681 return secretbox.Encrypt(s.key, plain)
682}
683
684func (s *Store) decrypt(nonce, ct []byte) (string, error) {
685 return secretbox.Decrypt(s.key, nonce, ct)
686}
internal/webhook/webhook.go added +241 −0
@@ -0,0 +1,241 @@
1 // Package webhook filtert gebeurtenissen en vult URL, headers en body.
2 package webhook
3
4 import (
5 "encoding/json"
6 "fmt"
7 "regexp"
8 "strings"
9 )
10
11 // Soorten gebeurtenissen.
12 const (
13 EventPush = "push"
14 EventMergeRequest = "merge_request"
15 EventPipelineSuccess = "pipeline_success"
16 EventPipelineFailure = "pipeline_failure"
17 EventRelease = "release_published"
18 )
19
20 // AllEvents is de vaste lijst die een webhook mag aanvinken.
21 func AllEvents() []string {
22 return []string{EventPush, EventMergeRequest, EventPipelineSuccess, EventPipelineFailure, EventRelease}
23 }
24
25 // KnownEvent meldt of name een ondersteunde gebeurtenis is.
26 func KnownEvent(name string) bool {
27 for _, e := range AllEvents() {
28 if e == name {
29 return true
30 }
31 }
32 return false
33 }
34
35 // Presets.
36 const (
37 PresetDiscord = "discord"
38 PresetGrok = "grok"
39 PresetGeneric = "generic"
40 )
41
42 // Event is de gegevensset die een webhook te zien krijgt.
43 type Event struct {
44 Type string
45 Project string
46 Group string
47 Branch string
48 Commit string
49 Summary string
50 URL string
51 PipelineID string
52 ReleaseTag string
53 Actor string
54 }
55
56 // Hook is de opgeslagen configuratie, zonder geheimen al ingevuld.
57 type Hook struct {
58 Preset string
59 Events []string
60 BranchFilter string
61 }
62
63 // Allows meldt of deze hook de gebeurtenis wil ontvangen.
64 // Het branchfilter geldt alleen voor push. Leeg betekent alle branches.
65 // "re:" gevolgd door een reguliere expressie, anders een exacte branchnaam.
66 func Allows(h Hook, ev Event) (bool, error) {
67 if !KnownEvent(ev.Type) {
68 return false, fmt.Errorf("onbekende gebeurtenis %q", ev.Type)
69 }
70 found := false
71 for _, e := range h.Events {
72 if e == ev.Type {
73 found = true
74 break
75 }
76 }
77 if !found {
78 return false, nil
79 }
80 if ev.Type != EventPush {
81 return true, nil
82 }
83 return MatchBranch(h.BranchFilter, ev.Branch)
84 }
85
86 // MatchBranch past een push-filter toe.
87 func MatchBranch(filter, branch string) (bool, error) {
88 filter = strings.TrimSpace(filter)
89 if filter == "" {
90 return true, nil
91 }
92 if strings.HasPrefix(filter, "re:") {
93 re, err := regexp.Compile(strings.TrimPrefix(filter, "re:"))
94 if err != nil {
95 return false, fmt.Errorf("branchfilter: %w", err)
96 }
97 return re.MatchString(branch), nil
98 }
99 return filter == branch, nil
100 }
101
102 // Expand vult {{event.veld}} en {{secret.NAAM}}.
103 // Een onbekend geheim of veld is een fout, zodat een webhook niet
104 // per ongeluk met een leeg token vertrekt.
105 func Expand(s string, ev Event, secrets map[string]string) (string, error) {
106 var b strings.Builder
107 for {
108 start := strings.Index(s, "{{")
109 if start < 0 {
110 b.WriteString(s)
111 break
112 }
113 b.WriteString(s[:start])
114 rest := s[start+2:]
115 end := strings.Index(rest, "}}")
116 if end < 0 {
117 return "", fmt.Errorf("onafgesloten {{ in sjabloon")
118 }
119 key := strings.TrimSpace(rest[:end])
120 val, err := lookup(key, ev, secrets)
121 if err != nil {
122 return "", err
123 }
124 b.WriteString(val)
125 s = rest[end+2:]
126 }
127 return b.String(), nil
128 }
129
130 func lookup(key string, ev Event, secrets map[string]string) (string, error) {
131 switch {
132 case strings.HasPrefix(key, "secret."):
133 name := strings.TrimPrefix(key, "secret.")
134 v, ok := secrets[name]
135 if !ok {
136 return "", fmt.Errorf("geheim %s bestaat niet", name)
137 }
138 return v, nil
139 case strings.HasPrefix(key, "event."):
140 field := strings.TrimPrefix(key, "event.")
141 v, ok := eventField(ev, field)
142 if !ok {
143 return "", fmt.Errorf("onbekend veld event.%s", field)
144 }
145 return v, nil
146 default:
147 return "", fmt.Errorf("onbekende plaatsaanduiding %q", key)
148 }
149 }
150
151 func eventField(ev Event, field string) (string, bool) {
152 switch field {
153 case "type":
154 return ev.Type, true
155 case "project":
156 return ev.Project, true
157 case "group":
158 return ev.Group, true
159 case "branch":
160 return ev.Branch, true
161 case "commit":
162 return ev.Commit, true
163 case "summary":
164 return ev.Summary, true
165 case "url":
166 return ev.URL, true
167 case "pipeline_id":
168 return ev.PipelineID, true
169 case "release_tag":
170 return ev.ReleaseTag, true
171 case "actor":
172 return ev.Actor, true
173 default:
174 return "", false
175 }
176 }
177
178 // PresetDefaults vult URL-headers en body als de gebruiker een preset kiest
179 // en een veld leeg laat.
180 func PresetDefaults(preset string) (headers map[string]string, body string) {
181 switch preset {
182 case PresetDiscord:
183 return map[string]string{"Content-Type": "application/json"}, `{"content":"{{event.summary}}"}`
184 case PresetGrok:
185 return map[string]string{
186 "Content-Type": "application/json",
187 "Authorization": "Bearer {{secret.GROK_TOKEN}}",
188 }, ""
189 default:
190 return map[string]string{"Content-Type": "application/json"}, ""
191 }
192 }
193
194 // RenderBody maakt de HTTP-body. Een lege sjabloon wordt de gebeurtenis als JSON.
195 func RenderBody(bodyTemplate string, ev Event, secrets map[string]string) ([]byte, error) {
196 if strings.TrimSpace(bodyTemplate) == "" {
197 payload := map[string]string{
198 "type": ev.Type,
199 "project": ev.Project,
200 "group": ev.Group,
201 "branch": ev.Branch,
202 "commit": ev.Commit,
203 "summary": ev.Summary,
204 "url": ev.URL,
205 "pipeline_id": ev.PipelineID,
206 "release_tag": ev.ReleaseTag,
207 "actor": ev.Actor,
208 }
209 return json.Marshal(payload)
210 }
211 s, err := Expand(bodyTemplate, ev, secrets)
212 if err != nil {
213 return nil, err
214 }
215 return []byte(s), nil
216 }
217
218 // RenderHeaders vult geheimen in headers. Preset-headers vullen alleen
219 // ontbrekende sleutels aan.
220 func RenderHeaders(preset string, configured map[string]string, ev Event, secrets map[string]string) (map[string]string, error) {
221 base, _ := PresetDefaults(preset)
222 if base == nil {
223 base = map[string]string{}
224 }
225 for k, v := range configured {
226 base[k] = v
227 }
228 out := map[string]string{}
229 for k, v := range base {
230 ek, err := Expand(k, ev, secrets)
231 if err != nil {
232 return nil, err
233 }
234 evv, err := Expand(v, ev, secrets)
235 if err != nil {
236 return nil, err
237 }
238 out[ek] = evv
239 }
240 return out, nil
241 }
@@ -0,0 +1,241 @@
1// Package webhook filtert gebeurtenissen en vult URL, headers en body.
2package webhook
3
4import (
5 "encoding/json"
6 "fmt"
7 "regexp"
8 "strings"
9)
10
11// Soorten gebeurtenissen.
12const (
13 EventPush = "push"
14 EventMergeRequest = "merge_request"
15 EventPipelineSuccess = "pipeline_success"
16 EventPipelineFailure = "pipeline_failure"
17 EventRelease = "release_published"
18)
19
20// AllEvents is de vaste lijst die een webhook mag aanvinken.
21func AllEvents() []string {
22 return []string{EventPush, EventMergeRequest, EventPipelineSuccess, EventPipelineFailure, EventRelease}
23}
24
25// KnownEvent meldt of name een ondersteunde gebeurtenis is.
26func KnownEvent(name string) bool {
27 for _, e := range AllEvents() {
28 if e == name {
29 return true
30 }
31 }
32 return false
33}
34
35// Presets.
36const (
37 PresetDiscord = "discord"
38 PresetGrok = "grok"
39 PresetGeneric = "generic"
40)
41
42// Event is de gegevensset die een webhook te zien krijgt.
43type Event struct {
44 Type string
45 Project string
46 Group string
47 Branch string
48 Commit string
49 Summary string
50 URL string
51 PipelineID string
52 ReleaseTag string
53 Actor string
54}
55
56// Hook is de opgeslagen configuratie, zonder geheimen al ingevuld.
57type Hook struct {
58 Preset string
59 Events []string
60 BranchFilter string
61}
62
63// Allows meldt of deze hook de gebeurtenis wil ontvangen.
64// Het branchfilter geldt alleen voor push. Leeg betekent alle branches.
65// "re:" gevolgd door een reguliere expressie, anders een exacte branchnaam.
66func Allows(h Hook, ev Event) (bool, error) {
67 if !KnownEvent(ev.Type) {
68 return false, fmt.Errorf("onbekende gebeurtenis %q", ev.Type)
69 }
70 found := false
71 for _, e := range h.Events {
72 if e == ev.Type {
73 found = true
74 break
75 }
76 }
77 if !found {
78 return false, nil
79 }
80 if ev.Type != EventPush {
81 return true, nil
82 }
83 return MatchBranch(h.BranchFilter, ev.Branch)
84}
85
86// MatchBranch past een push-filter toe.
87func MatchBranch(filter, branch string) (bool, error) {
88 filter = strings.TrimSpace(filter)
89 if filter == "" {
90 return true, nil
91 }
92 if strings.HasPrefix(filter, "re:") {
93 re, err := regexp.Compile(strings.TrimPrefix(filter, "re:"))
94 if err != nil {
95 return false, fmt.Errorf("branchfilter: %w", err)
96 }
97 return re.MatchString(branch), nil
98 }
99 return filter == branch, nil
100}
101
102// Expand vult {{event.veld}} en {{secret.NAAM}}.
103// Een onbekend geheim of veld is een fout, zodat een webhook niet
104// per ongeluk met een leeg token vertrekt.
105func Expand(s string, ev Event, secrets map[string]string) (string, error) {
106 var b strings.Builder
107 for {
108 start := strings.Index(s, "{{")
109 if start < 0 {
110 b.WriteString(s)
111 break
112 }
113 b.WriteString(s[:start])
114 rest := s[start+2:]
115 end := strings.Index(rest, "}}")
116 if end < 0 {
117 return "", fmt.Errorf("onafgesloten {{ in sjabloon")
118 }
119 key := strings.TrimSpace(rest[:end])
120 val, err := lookup(key, ev, secrets)
121 if err != nil {
122 return "", err
123 }
124 b.WriteString(val)
125 s = rest[end+2:]
126 }
127 return b.String(), nil
128}
129
130func lookup(key string, ev Event, secrets map[string]string) (string, error) {
131 switch {
132 case strings.HasPrefix(key, "secret."):
133 name := strings.TrimPrefix(key, "secret.")
134 v, ok := secrets[name]
135 if !ok {
136 return "", fmt.Errorf("geheim %s bestaat niet", name)
137 }
138 return v, nil
139 case strings.HasPrefix(key, "event."):
140 field := strings.TrimPrefix(key, "event.")
141 v, ok := eventField(ev, field)
142 if !ok {
143 return "", fmt.Errorf("onbekend veld event.%s", field)
144 }
145 return v, nil
146 default:
147 return "", fmt.Errorf("onbekende plaatsaanduiding %q", key)
148 }
149}
150
151func eventField(ev Event, field string) (string, bool) {
152 switch field {
153 case "type":
154 return ev.Type, true
155 case "project":
156 return ev.Project, true
157 case "group":
158 return ev.Group, true
159 case "branch":
160 return ev.Branch, true
161 case "commit":
162 return ev.Commit, true
163 case "summary":
164 return ev.Summary, true
165 case "url":
166 return ev.URL, true
167 case "pipeline_id":
168 return ev.PipelineID, true
169 case "release_tag":
170 return ev.ReleaseTag, true
171 case "actor":
172 return ev.Actor, true
173 default:
174 return "", false
175 }
176}
177
178// PresetDefaults vult URL-headers en body als de gebruiker een preset kiest
179// en een veld leeg laat.
180func PresetDefaults(preset string) (headers map[string]string, body string) {
181 switch preset {
182 case PresetDiscord:
183 return map[string]string{"Content-Type": "application/json"}, `{"content":"{{event.summary}}"}`
184 case PresetGrok:
185 return map[string]string{
186 "Content-Type": "application/json",
187 "Authorization": "Bearer {{secret.GROK_TOKEN}}",
188 }, ""
189 default:
190 return map[string]string{"Content-Type": "application/json"}, ""
191 }
192}
193
194// RenderBody maakt de HTTP-body. Een lege sjabloon wordt de gebeurtenis als JSON.
195func RenderBody(bodyTemplate string, ev Event, secrets map[string]string) ([]byte, error) {
196 if strings.TrimSpace(bodyTemplate) == "" {
197 payload := map[string]string{
198 "type": ev.Type,
199 "project": ev.Project,
200 "group": ev.Group,
201 "branch": ev.Branch,
202 "commit": ev.Commit,
203 "summary": ev.Summary,
204 "url": ev.URL,
205 "pipeline_id": ev.PipelineID,
206 "release_tag": ev.ReleaseTag,
207 "actor": ev.Actor,
208 }
209 return json.Marshal(payload)
210 }
211 s, err := Expand(bodyTemplate, ev, secrets)
212 if err != nil {
213 return nil, err
214 }
215 return []byte(s), nil
216}
217
218// RenderHeaders vult geheimen in headers. Preset-headers vullen alleen
219// ontbrekende sleutels aan.
220func RenderHeaders(preset string, configured map[string]string, ev Event, secrets map[string]string) (map[string]string, error) {
221 base, _ := PresetDefaults(preset)
222 if base == nil {
223 base = map[string]string{}
224 }
225 for k, v := range configured {
226 base[k] = v
227 }
228 out := map[string]string{}
229 for k, v := range base {
230 ek, err := Expand(k, ev, secrets)
231 if err != nil {
232 return nil, err
233 }
234 evv, err := Expand(v, ev, secrets)
235 if err != nil {
236 return nil, err
237 }
238 out[ek] = evv
239 }
240 return out, nil
241}
internal/webhook/webhook_test.go added +111 −0
@@ -0,0 +1,111 @@
1 package webhook
2
3 import (
4 "encoding/json"
5 "strings"
6 "testing"
7 )
8
9 func TestBranchFilter(t *testing.T) {
10 ok, err := MatchBranch("", "main")
11 if err != nil || !ok {
12 t.Fatal("leeg filter")
13 }
14 ok, err = MatchBranch("main", "main")
15 if err != nil || !ok {
16 t.Fatal("exact")
17 }
18 ok, err = MatchBranch("main", "feature")
19 if err != nil || ok {
20 t.Fatal("exact geen treffer")
21 }
22 ok, err = MatchBranch(`re:^release/.*`, "release/1.2")
23 if err != nil || !ok {
24 t.Fatal("regex")
25 }
26 ok, err = MatchBranch(`re:^release/.*`, "main")
27 if err != nil || ok {
28 t.Fatal("regex geen treffer")
29 }
30 if _, err := MatchBranch(`re:(`, "main"); err == nil {
31 t.Fatal("kapotte regex")
32 }
33 }
34
35 func TestAllows(t *testing.T) {
36 h := Hook{Events: []string{EventPush, EventPipelineSuccess}, BranchFilter: "main"}
37 ok, err := Allows(h, Event{Type: EventPush, Branch: "main"})
38 if err != nil || !ok {
39 t.Fatal("push main")
40 }
41 ok, err = Allows(h, Event{Type: EventPush, Branch: "dev"})
42 if err != nil || ok {
43 t.Fatal("push dev gefilterd")
44 }
45 ok, err = Allows(h, Event{Type: EventPipelineFailure})
46 if err != nil || ok {
47 t.Fatal("failure staat niet aan")
48 }
49 ok, err = Allows(h, Event{Type: EventPipelineSuccess, Branch: "dev"})
50 if err != nil || !ok {
51 t.Fatal("pipeline negeert het branchfilter")
52 }
53 ok, err = Allows(h, Event{Type: EventMergeRequest})
54 if err != nil || ok {
55 t.Fatal("mr staat uit")
56 }
57 if _, err := Allows(h, Event{Type: "ping"}); err == nil {
58 t.Fatal("onbekend event")
59 }
60 }
61
62 func TestExpandAndPresets(t *testing.T) {
63 ev := Event{
64 Type: EventPush,
65 Project: "tim/bluegit",
66 Branch: "master",
67 Commit: "abc",
68 Summary: "tim pushte naar master",
69 URL: "https://git.timfalken.com/tim/bluegit",
70 Actor: "tim",
71 }
72 secrets := map[string]string{"GROK_TOKEN": "geheim-token", "HOOK": "https://example.test/hook"}
73 got, err := Expand("{{secret.HOOK}}/{{event.project}}", ev, secrets)
74 if err != nil || got != "https://example.test/hook/tim/bluegit" {
75 t.Fatalf("expand %q %v", got, err)
76 }
77 if _, err := Expand("{{secret.NOPE}}", ev, secrets); err == nil {
78 t.Fatal("ontbrekend geheim")
79 }
80 if _, err := Expand("{{event.nope}}", ev, secrets); err == nil {
81 t.Fatal("onbekend veld")
82 }
83
84 headers, err := RenderHeaders(PresetGrok, nil, ev, secrets)
85 if err != nil {
86 t.Fatal(err)
87 }
88 if headers["Authorization"] != "Bearer geheim-token" {
89 t.Fatalf("grok-header %q", headers["Authorization"])
90 }
91 body, err := RenderBody("", ev, secrets)
92 if err != nil {
93 t.Fatal(err)
94 }
95 var payload map[string]string
96 if err := json.Unmarshal(body, &payload); err != nil {
97 t.Fatal(err)
98 }
99 if payload["project"] != "tim/bluegit" || strings.Contains(string(body), "geheim-token") {
100 t.Fatalf("body lekt of mist project: %s", body)
101 }
102
103 dHeaders, dBody := PresetDefaults(PresetDiscord)
104 if dHeaders["Content-Type"] == "" || !strings.Contains(dBody, "{{event.summary}}") {
105 t.Fatal("discord-preset")
106 }
107 rendered, err := RenderBody(dBody, ev, secrets)
108 if err != nil || !strings.Contains(string(rendered), "tim pushte naar master") {
109 t.Fatalf("discord body %s %v", rendered, err)
110 }
111 }
@@ -0,0 +1,111 @@
1package webhook
2
3import (
4 "encoding/json"
5 "strings"
6 "testing"
7)
8
9func TestBranchFilter(t *testing.T) {
10 ok, err := MatchBranch("", "main")
11 if err != nil || !ok {
12 t.Fatal("leeg filter")
13 }
14 ok, err = MatchBranch("main", "main")
15 if err != nil || !ok {
16 t.Fatal("exact")
17 }
18 ok, err = MatchBranch("main", "feature")
19 if err != nil || ok {
20 t.Fatal("exact geen treffer")
21 }
22 ok, err = MatchBranch(`re:^release/.*`, "release/1.2")
23 if err != nil || !ok {
24 t.Fatal("regex")
25 }
26 ok, err = MatchBranch(`re:^release/.*`, "main")
27 if err != nil || ok {
28 t.Fatal("regex geen treffer")
29 }
30 if _, err := MatchBranch(`re:(`, "main"); err == nil {
31 t.Fatal("kapotte regex")
32 }
33}
34
35func TestAllows(t *testing.T) {
36 h := Hook{Events: []string{EventPush, EventPipelineSuccess}, BranchFilter: "main"}
37 ok, err := Allows(h, Event{Type: EventPush, Branch: "main"})
38 if err != nil || !ok {
39 t.Fatal("push main")
40 }
41 ok, err = Allows(h, Event{Type: EventPush, Branch: "dev"})
42 if err != nil || ok {
43 t.Fatal("push dev gefilterd")
44 }
45 ok, err = Allows(h, Event{Type: EventPipelineFailure})
46 if err != nil || ok {
47 t.Fatal("failure staat niet aan")
48 }
49 ok, err = Allows(h, Event{Type: EventPipelineSuccess, Branch: "dev"})
50 if err != nil || !ok {
51 t.Fatal("pipeline negeert het branchfilter")
52 }
53 ok, err = Allows(h, Event{Type: EventMergeRequest})
54 if err != nil || ok {
55 t.Fatal("mr staat uit")
56 }
57 if _, err := Allows(h, Event{Type: "ping"}); err == nil {
58 t.Fatal("onbekend event")
59 }
60}
61
62func TestExpandAndPresets(t *testing.T) {
63 ev := Event{
64 Type: EventPush,
65 Project: "tim/bluegit",
66 Branch: "master",
67 Commit: "abc",
68 Summary: "tim pushte naar master",
69 URL: "https://git.timfalken.com/tim/bluegit",
70 Actor: "tim",
71 }
72 secrets := map[string]string{"GROK_TOKEN": "geheim-token", "HOOK": "https://example.test/hook"}
73 got, err := Expand("{{secret.HOOK}}/{{event.project}}", ev, secrets)
74 if err != nil || got != "https://example.test/hook/tim/bluegit" {
75 t.Fatalf("expand %q %v", got, err)
76 }
77 if _, err := Expand("{{secret.NOPE}}", ev, secrets); err == nil {
78 t.Fatal("ontbrekend geheim")
79 }
80 if _, err := Expand("{{event.nope}}", ev, secrets); err == nil {
81 t.Fatal("onbekend veld")
82 }
83
84 headers, err := RenderHeaders(PresetGrok, nil, ev, secrets)
85 if err != nil {
86 t.Fatal(err)
87 }
88 if headers["Authorization"] != "Bearer geheim-token" {
89 t.Fatalf("grok-header %q", headers["Authorization"])
90 }
91 body, err := RenderBody("", ev, secrets)
92 if err != nil {
93 t.Fatal(err)
94 }
95 var payload map[string]string
96 if err := json.Unmarshal(body, &payload); err != nil {
97 t.Fatal(err)
98 }
99 if payload["project"] != "tim/bluegit" || strings.Contains(string(body), "geheim-token") {
100 t.Fatalf("body lekt of mist project: %s", body)
101 }
102
103 dHeaders, dBody := PresetDefaults(PresetDiscord)
104 if dHeaders["Content-Type"] == "" || !strings.Contains(dBody, "{{event.summary}}") {
105 t.Fatal("discord-preset")
106 }
107 rendered, err := RenderBody(dBody, ev, secrets)
108 if err != nil || !strings.Contains(string(rendered), "tim pushte naar master") {
109 t.Fatalf("discord body %s %v", rendered, err)
110 }
111}
packaging/arch/PKGBUILD added +32 −0
@@ -0,0 +1,32 @@
1 # Maintainer: Tim Falken <tim@timfalken.com>
2 pkgname=bluegit
3 pkgver=0.1.0
4 pkgrel=1
5 pkgdesc='Self-hosted git-platform voor git.timfalken.com'
6 arch=('x86_64')
7 url='https://git.timfalken.com'
8 license=('MIT')
9 depends=('git' 'docker')
10 makedepends=('go')
11 backup=('etc/bluegit/config.yml')
12 options=('!debug')
13
14 build() {
15 local root
16 root="$(cd "$startdir/../.." && pwd)"
17 cd "$root"
18 export CGO_ENABLED=0
19 export GOFLAGS='-trimpath'
20 go build -ldflags='-s -w' -o "$srcdir/bluegit" ./cmd/bluegit
21 }
22
23 package() {
24 local root
25 root="$(cd "$startdir/../.." && pwd)"
26 install -Dm755 "$srcdir/bluegit" "$pkgdir/usr/bin/bluegit"
27 install -Dm644 "$root/packaging/bluegit.service" "$pkgdir/usr/lib/systemd/system/bluegit.service"
28 install -Dm644 "$root/packaging/bluegit.yml" "$pkgdir/etc/bluegit/config.yml"
29 install -Dm644 "$root/packaging/storage.conf" "$pkgdir/usr/share/bluegit/storage.conf.example"
30 install -Dm644 "$root/packaging/sysusers.conf" "$pkgdir/usr/lib/sysusers.d/bluegit.conf"
31 install -Dm644 "$root/packaging/tmpfiles.conf" "$pkgdir/usr/lib/tmpfiles.d/bluegit.conf"
32 }
@@ -0,0 +1,32 @@
1# Maintainer: Tim Falken <tim@timfalken.com>
2pkgname=bluegit
3pkgver=0.1.0
4pkgrel=1
5pkgdesc='Self-hosted git-platform voor git.timfalken.com'
6arch=('x86_64')
7url='https://git.timfalken.com'
8license=('MIT')
9depends=('git' 'docker')
10makedepends=('go')
11backup=('etc/bluegit/config.yml')
12options=('!debug')
13
14build() {
15 local root
16 root="$(cd "$startdir/../.." && pwd)"
17 cd "$root"
18 export CGO_ENABLED=0
19 export GOFLAGS='-trimpath'
20 go build -ldflags='-s -w' -o "$srcdir/bluegit" ./cmd/bluegit
21}
22
23package() {
24 local root
25 root="$(cd "$startdir/../.." && pwd)"
26 install -Dm755 "$srcdir/bluegit" "$pkgdir/usr/bin/bluegit"
27 install -Dm644 "$root/packaging/bluegit.service" "$pkgdir/usr/lib/systemd/system/bluegit.service"
28 install -Dm644 "$root/packaging/bluegit.yml" "$pkgdir/etc/bluegit/config.yml"
29 install -Dm644 "$root/packaging/storage.conf" "$pkgdir/usr/share/bluegit/storage.conf.example"
30 install -Dm644 "$root/packaging/sysusers.conf" "$pkgdir/usr/lib/sysusers.d/bluegit.conf"
31 install -Dm644 "$root/packaging/tmpfiles.conf" "$pkgdir/usr/lib/tmpfiles.d/bluegit.conf"
32}
packaging/bluegit.service added +25 −0
@@ -0,0 +1,25 @@
1 [Unit]
2 Description=BlueGit
3 After=network-online.target docker.service
4 Wants=network-online.target
5
6 [Service]
7 Type=simple
8 User=bluegit
9 Group=bluegit
10 SupplementaryGroups=docker
11 EnvironmentFile=-/etc/bluegit/secret.env
12 ExecStart=/usr/bin/bluegit serve --config /etc/bluegit/config.yml
13 Restart=on-failure
14 NoNewPrivileges=true
15 ProtectSystem=strict
16 ProtectHome=true
17 # StateDirectory maakt /var/lib/bluegit aan. Daar staan database, sleutel
18 # en hostkey. De datadisk kiest de beheerder in de webinterface; voeg dat
19 # pad toe via packaging/storage.conf, want ProtectSystem blokkeert het anders.
20 StateDirectory=bluegit
21 ReadWritePaths=/var/lib/bluegit
22 PrivateTmp=true
23
24 [Install]
25 WantedBy=multi-user.target
@@ -0,0 +1,25 @@
1[Unit]
2Description=BlueGit
3After=network-online.target docker.service
4Wants=network-online.target
5
6[Service]
7Type=simple
8User=bluegit
9Group=bluegit
10SupplementaryGroups=docker
11EnvironmentFile=-/etc/bluegit/secret.env
12ExecStart=/usr/bin/bluegit serve --config /etc/bluegit/config.yml
13Restart=on-failure
14NoNewPrivileges=true
15ProtectSystem=strict
16ProtectHome=true
17# StateDirectory maakt /var/lib/bluegit aan. Daar staan database, sleutel
18# en hostkey. De datadisk kiest de beheerder in de webinterface; voeg dat
19# pad toe via packaging/storage.conf, want ProtectSystem blokkeert het anders.
20StateDirectory=bluegit
21ReadWritePaths=/var/lib/bluegit
22PrivateTmp=true
23
24[Install]
25WantedBy=multi-user.target
packaging/bluegit.yml added +41 −0
@@ -0,0 +1,41 @@
1 # Voorbeeld voor de mini-PC. Kopieer naar /etc/bluegit/config.yml.
2 # Plain HTTP. TLS en de publieke SSH-poort doet de ingress, zie docs/INGRESS.md.
3 base_url: https://git.timfalken.com
4 listen: 0.0.0.0:8080
5 # Database, sleutel en het gekozen opslagpad. Dit is niet de datadisk.
6 state_path: /var/lib/bluegit
7 # storage_path blijft leeg. De installatiebeheerder kiest de datadisk
8 # bij de eerste aanmelding. Er is geen standaardpad.
9 # Alleen deze adressen mogen X-Forwarded-For en X-Real-IP zetten.
10 # Zet hier het IP van de ingress, zoals de mini-PC die verbinding ziet.
11 trusted_proxies:
12 - 10.0.0.2
13
14 auth:
15 mode: oauth
16 base_url: https://auth.timfalken.com
17 # Het domein is de client_id. Registreer het pad /auth/callback bij /admin.
18 client_id: git.timfalken.com
19 client_secret: ""
20 client_secret_file: /etc/bluegit/client_secret
21 redirect_path: /auth/callback
22 user_agent: BlueGitAccountClient/0.1
23
24 git:
25 binary: git
26 default_branch: master
27
28 ssh:
29 enabled: true
30 # Waar dit proces git-SSH aanneemt. De SSH van het besturingssysteem blijft vrij.
31 listen: 0.0.0.0:2222
32 # Wat gebruikers in de clone-URL zien. De ingress stuurt poort 22 hiernaartoe.
33 public_host: git.timfalken.com
34 public_port: 22
35
36 ci:
37 enabled: true
38 docker_binary: docker
39 concurrency: 1
40 network: bridge
41 timeout_seconds: 1800
@@ -0,0 +1,41 @@
1# Voorbeeld voor de mini-PC. Kopieer naar /etc/bluegit/config.yml.
2# Plain HTTP. TLS en de publieke SSH-poort doet de ingress, zie docs/INGRESS.md.
3base_url: https://git.timfalken.com
4listen: 0.0.0.0:8080
5# Database, sleutel en het gekozen opslagpad. Dit is niet de datadisk.
6state_path: /var/lib/bluegit
7# storage_path blijft leeg. De installatiebeheerder kiest de datadisk
8# bij de eerste aanmelding. Er is geen standaardpad.
9# Alleen deze adressen mogen X-Forwarded-For en X-Real-IP zetten.
10# Zet hier het IP van de ingress, zoals de mini-PC die verbinding ziet.
11trusted_proxies:
12 - 10.0.0.2
13
14auth:
15 mode: oauth
16 base_url: https://auth.timfalken.com
17 # Het domein is de client_id. Registreer het pad /auth/callback bij /admin.
18 client_id: git.timfalken.com
19 client_secret: ""
20 client_secret_file: /etc/bluegit/client_secret
21 redirect_path: /auth/callback
22 user_agent: BlueGitAccountClient/0.1
23
24git:
25 binary: git
26 default_branch: master
27
28ssh:
29 enabled: true
30 # Waar dit proces git-SSH aanneemt. De SSH van het besturingssysteem blijft vrij.
31 listen: 0.0.0.0:2222
32 # Wat gebruikers in de clone-URL zien. De ingress stuurt poort 22 hiernaartoe.
33 public_host: git.timfalken.com
34 public_port: 22
35
36ci:
37 enabled: true
38 docker_binary: docker
39 concurrency: 1
40 network: bridge
41 timeout_seconds: 1800
packaging/install.sh added +23 −0
@@ -0,0 +1,23 @@
1 #!/bin/sh
2 # Installeert BlueGit op Arch zonder makepkg.
3 # Gebruik: sudo packaging/install.sh
4 set -eu
5 root=$(CDPATH= cd -- "$(dirname "$0")/.." && pwd)
6 cd "$root"
7 export CGO_ENABLED=0
8 go build -trimpath -ldflags='-s -w' -o bluegit ./cmd/bluegit
9 install -Dm755 bluegit /usr/bin/bluegit
10 install -Dm644 packaging/bluegit.service /usr/lib/systemd/system/bluegit.service
11 install -Dm644 packaging/sysusers.conf /usr/lib/sysusers.d/bluegit.conf
12 install -Dm644 packaging/tmpfiles.conf /usr/lib/tmpfiles.d/bluegit.conf
13 install -Dm644 packaging/storage.conf /usr/share/bluegit/storage.conf.example
14 if [ ! -f /etc/bluegit/config.yml ]; then
15 install -Dm640 packaging/bluegit.yml /etc/bluegit/config.yml
16 fi
17 systemd-sysusers bluegit.conf || true
18 systemd-tmpfiles --create bluegit.conf || true
19 systemctl daemon-reload
20 echo "Klaar. Vul /etc/bluegit/client_secret."
21 echo "De database komt in /var/lib/bluegit. Kies de datadisk zelf: kopieer /usr/share/bluegit/storage.conf.example naar /etc/systemd/system/bluegit.service.d/storage.conf en zet ReadWritePaths op die map."
22 echo "Daarna: systemctl daemon-reload && systemctl enable --now bluegit"
23 echo "De eerste aanmelding kiest hetzelfde pad in het setup-scherm. Git en CI doen niets tot dat gebeurd is."
@@ -0,0 +1,23 @@
1#!/bin/sh
2# Installeert BlueGit op Arch zonder makepkg.
3# Gebruik: sudo packaging/install.sh
4set -eu
5root=$(CDPATH= cd -- "$(dirname "$0")/.." && pwd)
6cd "$root"
7export CGO_ENABLED=0
8go build -trimpath -ldflags='-s -w' -o bluegit ./cmd/bluegit
9install -Dm755 bluegit /usr/bin/bluegit
10install -Dm644 packaging/bluegit.service /usr/lib/systemd/system/bluegit.service
11install -Dm644 packaging/sysusers.conf /usr/lib/sysusers.d/bluegit.conf
12install -Dm644 packaging/tmpfiles.conf /usr/lib/tmpfiles.d/bluegit.conf
13install -Dm644 packaging/storage.conf /usr/share/bluegit/storage.conf.example
14if [ ! -f /etc/bluegit/config.yml ]; then
15 install -Dm640 packaging/bluegit.yml /etc/bluegit/config.yml
16fi
17systemd-sysusers bluegit.conf || true
18systemd-tmpfiles --create bluegit.conf || true
19systemctl daemon-reload
20echo "Klaar. Vul /etc/bluegit/client_secret."
21echo "De database komt in /var/lib/bluegit. Kies de datadisk zelf: kopieer /usr/share/bluegit/storage.conf.example naar /etc/systemd/system/bluegit.service.d/storage.conf en zet ReadWritePaths op die map."
22echo "Daarna: systemctl daemon-reload && systemctl enable --now bluegit"
23echo "De eerste aanmelding kiest hetzelfde pad in het setup-scherm. Git en CI doen niets tot dat gebeurd is."
packaging/storage.conf added +6 −0
@@ -0,0 +1,6 @@
1 # Zet dit neer als /etc/systemd/system/bluegit.service.d/storage.conf
2 # vóórdat de beheerder het pad in de webinterface opslaat.
3 # Vervang het pad door de datadisk. Er is geen standaardpad.
4 # Daarna: systemctl daemon-reload && systemctl restart bluegit
5 [Service]
6 ReadWritePaths=/pad/van/de/datadisk
@@ -0,0 +1,6 @@
1# Zet dit neer als /etc/systemd/system/bluegit.service.d/storage.conf
2# vóórdat de beheerder het pad in de webinterface opslaat.
3# Vervang het pad door de datadisk. Er is geen standaardpad.
4# Daarna: systemctl daemon-reload && systemctl restart bluegit
5[Service]
6ReadWritePaths=/pad/van/de/datadisk
packaging/sysusers.conf added +1 −0
@@ -0,0 +1 @@
1 u bluegit - "BlueGit" /var/lib/bluegit /usr/sbin/nologin
@@ -0,0 +1 @@
1u bluegit - "BlueGit" /var/lib/bluegit /usr/sbin/nologin
packaging/tmpfiles.conf added +1 −0
@@ -0,0 +1 @@
1 d /var/lib/bluegit 0750 bluegit bluegit -
@@ -0,0 +1 @@
1d /var/lib/bluegit 0750 bluegit bluegit -