94 Commits

Author SHA1 Message Date
Samantaz Fox
b4674ffae4
jobs: Allow each job to have its own config
Each job can define its own config options, that will be automatically
added to the global YAML config structure.

By default, all jobs get an "enable" property that can prevent a specific
job from running, e.g if the instance admin wants to manage the database
cleaning by themselves.
2022-10-03 22:51:37 +02:00
Émilien Devos
3d77642a1e
Disable decrypt_polling by default + add comment (#3244) 2022-08-06 17:09:10 +00:00
Émilien Devos
644ba46945
Remove mentions that decrypt_polling is broken
And add notice about bandwidth usage, related to https://github.com/iv-org/invidious/issues/3234
2022-08-06 10:09:45 +00:00
Samantaz Fox
7f445f6167
Merge pull request #2915 from MathiusD/RefreshChannelsJob-frenquency
Allow configuration of the time between 2 RefreshChannelsJob
2022-02-25 00:04:48 +01:00
Samantaz Fox
d8bb75be63
Document 'extend_desc' in config.example.yml
Thanks to "Le Jester" on Matrix for noticing that it was missing!
2022-02-23 21:50:30 +01:00
Féry Mathieu (Mathius)
e60a1836fe
Lint config.example.yml and config.cr
Follow lint indications :
- https://github.com/iv-org/invidious/pull/2915#discussion_r812396203
- https://github.com/iv-org/invidious/pull/2915#discussion_r812396807
2022-02-22 23:19:59 +01:00
Féry Mathieu (Mathius)
fd0ac3a671
Update management of channel_refresh_interval
Follow indications:
https://github.com/iv-org/invidious/pull/2915#discussion_r811373503
2022-02-22 01:35:35 +01:00
Féry Mathieu (Mathius)
dfab62ce48
Rename new property to channel_refresh_interval
Follow indications :
https://github.com/iv-org/invidious/pull/2915#discussion_r811373503
2022-02-22 00:46:26 +01:00
Féry Mathieu (Mathius)
18197e7e3e
Lint description of channel_refresh_time 2022-02-21 11:13:24 +01:00
Féry Mathieu (Mathius)
f75a81c9ee
Make configurable time between each RefreshChannelsJob 2022-02-21 10:53:20 +01:00
Dimitris Apostolou
7e4690e43c
Fix typos 2022-02-07 14:57:14 +02:00
Samantaz Fox
e00f9a869d
config: remove note about QUIC disabled at Google
The situation is back to normal.
2022-01-25 13:53:46 +01:00
Tony Finn
cdc007c83c
Specify the public schema for public videos
Unlike the other migrations, this one uses a bare table name to specify the table. This means it looks in the default search path. Unfortunately, the out of box search path is:

1. Schema with the same name as the user
2. Public

Because of this, if a schema exists with the same name as the DB user, the playlist_videos table will get created in _that_ schema, rather than the public schema, and then the grant statement will fail with an error like below if check_table is enabled as it keeps trying to create the table but failing on the grant statement:

```
2022-01-22 02:27:42 UTC [info] check_table: check_table: CREATE TABLE playlist_videos
Unhandled exception: relation "public.playlist_videos" does not exist (PQ::PQError)
  from /usr/share/crystal/src/primitives.cr:266:3 in 'handle_error'
  from lib/pg/src/pq/connection.cr:184:9 in 'handle_async_frames'
  from lib/pg/src/pq/connection.cr:162:7 in 'read'
  from lib/pg/src/pq/query.cr:53:14 in 'exec_all'
  from lib/db/src/db/database.cr:126:9 in '__crystal_main'
  from /usr/share/crystal/src/crystal/main.cr:110:5 in 'main'
  from src/env/__libc_start_main.c:94:2 in 'libc_start_main_stage2'
2022-01-22 02:27:43 UTC [info] check_table: check_table: CREATE TABLE playlist_videos
Unhandled exception: relation "public.playlist_videos" does not exist (PQ::PQError)
  from /usr/share/crystal/src/primitives.cr:266:3 in 'handle_error'
  from lib/pg/src/pq/connection.cr:184:9 in 'handle_async_frames'
  from lib/pg/src/pq/connection.cr:162:7 in 'read'
  from lib/pg/src/pq/query.cr:53:14 in 'exec_all'
  from lib/db/src/db/database.cr:126:9 in '__crystal_main'
  from /usr/share/crystal/src/crystal/main.cr:110:5 in 'main'
  from src/env/__libc_start_main.c:94:2 in 'libc_start_main_stage2'
```
2022-01-22 02:32:13 +00:00
Émilien Devos
7b9f5d74dc Create videos caching table as UNLOGGED 2022-01-09 16:58:29 +00:00
Samantaz Fox
4940759627
Example config: Change 'use_quic' default value
Related to commit a120f143d7bbe67379d0ff51e96b111661e1d385
Also point towards the Github issue.
2021-11-12 18:53:51 +01:00
Samantaz Fox
a12571e748
Fix minor error in config.example.yml
Update the "note" for `locale`
2021-11-12 02:32:15 +01:00
Dmitry Sandalov
ea0b1fdf44
Feature Request: Localization for trending (reword region doc) 2021-10-21 22:37:43 +03:00
Dmitry Sandalov
d9c58c4837
Feature Request: Localization for trending iv-org#331 2021-10-21 14:54:15 +03:00
JuniorJPDJ
df968d1919
variable postgres username and database name (#2451) 2021-10-11 19:16:56 +00:00
Samantaz Fox
adc12addfa
Add config option to display source code URL in footer (#2450) 2021-10-07 13:53:12 +02:00
syeopite
347c189f3f
Merge pull request #1678 from Rjevski/idempotent-database-migrations
Make DB migrations idempotent.
2021-10-03 18:53:35 +00:00
Samantaz Fox
9f5f5da894
config_example.yaml: document all possible options (#2083)
Fixes https://github.com/iv-org/documentation/issues/46
2021-07-16 20:34:40 +02:00
Andre Borie
79e99908de Allow providing 12-Factor-style Database URL in config 2021-01-30 19:33:58 +00:00
Andre Borie
ffa9e5dfab Make migrations (mostly) idempotent. 2021-01-17 14:20:34 +00:00
saltycrys
b566c4ba1a
Untrack config.yml (#1557)
* Untrack config.yml

`config/config.yml` has been untracked and moved to `config/config.example.yml`.

The Dockerfile has been updated to copy all `config/config.*` files and to try
to move `config/config.example.yml` to `config/config.yml`. If a user supplied
`config/config.yml` exists it is not overwritten.

* Update Dockerfile to use `shard.lock`

* Fix tests
2020-12-10 08:18:30 +01:00
Omar Roth
074497b0f6
Add migration script for polymer redesign 2020-06-15 18:20:31 -05:00
Omar Roth
1eca969cf6
Add support for polymer redesign 2020-06-15 18:18:04 -05:00
Omar Roth
61150c74d2
Move privacy type into playlists.sql 2020-04-14 18:09:48 -05:00
Omar Roth
be055d9dcb
Add support for custom playlists 2019-10-15 21:17:14 -04:00
Silvan Mosberger
418526af16
Provide db user in migrate-db-3646395.sh 2019-08-29 02:25:15 +02:00
Omar Roth
18d66ddded
Add 'needs_update' column for scheduling feed refresh 2019-06-01 10:19:18 -05:00
Omar Roth
64464f23ae
Add 'views' to channel_videos 2019-05-30 18:59:13 -05:00
Omar Roth
42dd6326d5 Remove unnecessary index 2019-04-28 14:11:23 -05:00
Omar Roth
698dfca319 Add migrate script for annotations.sql 2019-04-15 11:17:23 -05:00
Omar Roth
3bcb98e644 Add config option to cache annotations from IA 2019-04-15 11:13:09 -05:00
Omar Roth
c5001f3620 Add role to psql scripts 2019-04-06 07:38:33 -05:00
Omar Roth
591a6b330a Remove 'crawl_threads', fix sleep in fibers 2019-03-25 09:23:42 -05:00
Omar Roth
a1f49b279f Rename migrate scripts 2019-03-23 11:34:16 -05:00
Omar Roth
fd26f9f34e Add support for premieres to search and feed 2019-03-22 14:54:35 -05:00
Omar Roth
f0658bbd09 Add 'liveNow' to subscription feed 2019-03-22 14:52:57 -05:00
Omar Roth
90715467a2 Set default value for 'subscribed' date 2019-03-03 20:44:29 -06:00
Omar Roth
7425700009 Update pubsub to support lease_seconds 2019-03-03 20:40:24 -06:00
Omar Roth
64cfd2296c Add support for subscribing to channels via PubSubHubbub 2019-03-03 19:18:23 -06:00
Omar Roth
17cf0772fb Set domain to be nil by default 2019-03-03 12:02:15 -06:00
Omar Roth
52cad8d6da Update change index for channel_videos and add index for nonces 2019-02-11 10:59:17 -06:00
Omar Roth
ff563a70a5 Fix typo in session_ids 2019-02-10 15:08:53 -06:00
Omar Roth
5528a130b6 Mark migrate-db-3646395.sh as executable 2019-02-10 13:50:17 -06:00
Omar Roth
a384f6e5fd Add migrate script and update README 2019-02-10 12:46:58 -06:00
Omar Roth
3646395f1d Store session_ids in separate table 2019-02-10 12:33:29 -06:00
Omar Roth
0d509c82ee Rename migrate-db-e1aa1ce.sh to migrate-db-30e6d29.sh 2019-02-09 12:10:20 -06:00