Greg Heartsfield
25752abe6b
fix: run postgres migration on startup
2023-01-24 08:04:37 -06:00
Kieran
16f6e974c8
feat: add support for PostgreSQL as a backend repository
2023-01-22 16:26:54 -06:00
Kieran
4121c872bc
feat: prometheus metrics
...
Prometheus metrics exposed at /metrics
2023-01-22 11:08:12 -06:00
Greg Heartsfield
6489e685ab
refactor: reformat and remove tabs
2023-01-22 10:06:44 -06:00
Greg Heartsfield
6800c2e39d
improvement: add NostrRepo trait, with sqlite implementation
...
This is inspired by the work of
v0l (https://github.com/v0l/nostr-rs-relay/ ).
A new trait abstracts the storage layer with an async API. Rusqlite
is still used with worker threads, but this allows for Postgresql or
other backends to be used.
There may be bugs, this has not been rigorously tested.
2023-01-22 09:49:49 -06:00
Greg Heartsfield
13cc24b5cd
improvement: log blacklisted events
2023-01-15 15:42:27 -06:00
Greg Heartsfield
f543957b34
improvement: clear out hidden events during schema upgrade
2023-01-15 15:27:41 -06:00
Greg Heartsfield
7021f102e8
improvement: delete replaceable events
2023-01-15 15:13:10 -06:00
Greg Heartsfield
fddbf321bc
perf: add indexes and force their use (authors)
2023-01-15 10:52:49 -06:00
Greg Heartsfield
3e7f2e21df
perf: force authors index to be used if possible
2023-01-15 10:23:46 -06:00
Greg Heartsfield
9d9c6c78d1
improvement: refuse to insert events that would automatically be hidden
2023-01-15 10:01:01 -06:00
Greg Heartsfield
703b2efe6e
refactor: replaceable check in event
2023-01-15 09:18:53 -06:00
Greg Heartsfield
3d3d1bde53
refactor: clippy suggestions
2023-01-09 22:12:04 -06:00
Greg Heartsfield
62e8da689d
fix: do not force kind_created_at_index when there are tags
2023-01-06 12:57:48 -06:00
Greg Heartsfield
807d1aa384
improvement: log index names used
2023-01-06 12:50:52 -06:00
Greg Heartsfield
66a55b55b9
perf: new index, manually selected when appropriate
2023-01-06 12:17:30 -06:00
Greg Heartsfield
e9d2a2cbd0
perf(NIP-26): temporarily disable NIP-26 delegated events
2023-01-04 16:51:22 -06:00
Greg Heartsfield
39a945b493
perf: separate author/delegated_by queries, minor improvement
2023-01-04 16:51:17 -06:00
Greg Heartsfield
20c4bb42eb
fix: correct log message
2023-01-03 21:24:46 -06:00
Greg Heartsfield
3dd0f2c9c6
fix: do not run auto_vacuum on read-only connections
2023-01-03 17:32:55 -06:00
Greg Heartsfield
cb283ac316
fix: ensure that replaceable events are handled correctly regardless of order receieved
2023-01-02 17:18:11 -06:00
Greg Heartsfield
14fe9f9ee1
improvement: remove pauses for backups, likely not needed w/ WAL compaction
2023-01-02 15:38:30 -06:00
0xtr
7774db8c47
feat: add event kind blacklist
...
Adds a list to the config where you can specify which event kinds to blacklist.
The blacklist check will run right after verifying that the pubkey is allowed
to post events to the relay.
2022-12-27 17:10:34 -06:00
Greg Heartsfield
19ec89593d
improvement: drop queries that are running during a checkpoint
2022-12-27 15:24:10 -06:00
Greg Heartsfield
27902bc5f4
improvement: move reader mutex closer to DB connection acquisition
2022-12-27 10:28:56 -06:00
Greg Heartsfield
d2adddaee4
improvement: extend allowed wal_checkpoint timeout to 10 sec
2022-12-27 10:13:14 -06:00
Greg Heartsfield
b23b3ce8ec
improvement: block new readers when WAL is large
2022-12-27 09:48:07 -06:00
Greg Heartsfield
65fd0ed08b
feat: increase wal_checkpoint time when WAL is large
2022-12-26 10:03:51 -06:00
Greg Heartsfield
2e22334631
refactor: formatting
2022-12-25 11:06:30 -06:00
Greg Heartsfield
38dc7789dc
improvement: cleaner slow query logs
2022-12-25 10:47:32 -06:00
Greg Heartsfield
ce0e00ffb3
feat: log reader DB pool stats every minute
2022-12-25 10:47:32 -06:00
Greg Heartsfield
3e4ae4aeec
feat: cache prepared statements and trace expanded SQL queries
2022-12-25 10:47:32 -06:00
Greg Heartsfield
8137b6211c
refactor: clippy suggestions
2022-12-24 10:29:47 -06:00
Greg Heartsfield
e5074f2e46
feat(NIP-28): replaceable kind 41 channel metadata events
2022-12-24 10:14:43 -06:00
Greg Heartsfield
25480e837f
fix: do not block writers for more than 1 second during checkpoints
2022-12-22 16:10:49 -06:00
Greg Heartsfield
b80b54cd9d
improvement: reduce logging, especially for database pool size
2022-12-22 15:47:33 -06:00
Greg Heartsfield
8ea732cbe5
feat: perform regular database maintenance (60sec), without blocking main writer thread
2022-12-22 15:16:21 -06:00
Greg Heartsfield
0f68c4e5c2
refactor: formatting
2022-12-22 15:15:45 -06:00
Greg Heartsfield
d31bbda087
improvement: reduce lifetime of database connections
2022-12-22 13:01:12 -06:00
Greg Heartsfield
5917bc53b2
improvement: run maintenance every 60 seconds instead of by event count
2022-12-22 11:40:17 -06:00
Greg Heartsfield
53c2a8051c
improvement: reduce logging
2022-12-22 10:29:27 -06:00
Greg Heartsfield
168cf513ac
feat: perform full checkpoints and truncate WAL every 2k events
2022-12-22 10:11:05 -06:00
Greg Heartsfield
ea204761c9
fix: do not show slow queries more than once per sub
2022-12-20 15:41:50 -06:00
Greg Heartsfield
c270ae1434
improvement: reduce event count for db writer pauses
2022-12-20 15:25:24 -06:00
Greg Heartsfield
64bd983cb6
perf: every 5000 persisted events, pause for 500ms for backups
...
I have observed backups running for a very long time under heavy load,
this introduces some artificial delay to give the online backup enough
time to make progress.
2022-12-20 15:05:04 -06:00
Greg Heartsfield
1c153bc784
perf: shed DB query load when queue gets large
2022-12-20 13:23:21 -06:00
Greg Heartsfield
dc11d9a619
improvement: explicitly rollback transaction on duplicate event
2022-12-20 13:23:04 -06:00
Greg Heartsfield
cd1557787b
improvement: log write pool
2022-12-20 13:21:57 -06:00
Greg Heartsfield
86bb7aeb9a
improvement: function to check pool capacity
2022-12-20 10:07:01 -06:00
Greg Heartsfield
2cfd384339
perf: drop db handles that are not quickly read
2022-12-19 00:18:39 -06:00
Greg Heartsfield
Kieran
0xtr