mirror/RSS-Bridge.rss-bridge
1
0
Fork 0
mirror of https://github.com/RSS-Bridge/rss-bridge.git synced 2025-09-01 16:27:26 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
3869 commits 9 branches 38 tags 32 MiB
Commit graph

106 commits

Author SHA1 Message Date
Dag
191e5b0493
 		feat: add etag support to getContents (#3893) 2024-01-12 01:31:01 +01:00
Dag
080e29365a
 		feat(http-client): add http retry count to config (#3887) 2024-01-10 21:48:12 +01:00
Dag
98a94855dc
 		feat: embed response in http exception (#3847) 2023-12-20 03:16:25 +01:00
Dag
d157816e07
 		fix(reddit): cache tweak for 403 forbidden (#3830) 2023-12-13 21:56:14 +01:00
ORelio
4f7451895b
 		Fix: content.php: last-modified/if-unmodified-since (#3771) (#3772) 
* Fix: content.php: last-modified/if-unmodified-since (#3771)

Fix exception if server sent invalid Last-Modified header
Add support for Unix time instead of standard date string
Send back standard RFC7231 date string instead of Unix time

* Fix: content.php: if-unmodified-since: cURL API

Use getTimestamp() as cURL expects that and will format the If-Modified-Since header appropriately.
 2023-10-20 13:33:07 +02:00
Dag
6a72c56cdd
 		fix: various fixes (#3741) 2023-10-12 19:49:04 +02:00
Dag
547af0d0d2
 		refactor: use Json::encode instead of json_encode (#3724) 2023-10-01 20:54:28 +02:00
User123698745
69da0dd583
 		[refactoring] replace direct use of curl with getContents (#3723) 
+ some fixed warnings
 2023-10-01 20:46:51 +02:00
Dag
f421c45b21
 		test: add feed item test (#3709) 
* test: add feed item test

also some refactor

* yup

* yup
 2023-09-25 22:32:15 +02:00
Dag
e6aef73a02
 		refactor (#3668) 2023-09-20 02:45:48 +02:00
Dag
4b9f6f7e53
 		fix: rewrite and improve caching (#3594) 2023-09-10 21:50:15 +02:00
Dag
8e2353ad3e
 		fix: write to cache only if data is was not cached, fix #3586 (#3588) 2023-08-01 06:19:42 +02:00
Dag
74635fd752
 		fix(DisplayAction): improve error handling and cache logic (#3558) 
* fix(DisplayAction): improve error handling and cache logic

* restore prev timeouts

* refactor

* yup

* test: fix unit test

* leave twitter client unchanged

* leave twitter bridge unchanged
 2023-07-23 23:05:35 +02:00
Dag
517c7f5c9b
 		fix(cache): bug (#3554) 2023-07-19 22:18:42 +02:00
Dag
93620aa105
 		fix(cache): bug in cache logic (#3553) 
It is possible to have a cached item with a very old mtime but it's technically expired.

So, check for presence of time and whether the time it is within 10 days
 2023-07-19 22:05:26 +02:00
Dag
6254b8593e
 		refactor(cache): extract and encapsulate cache expiration logic (#3547) 
* refactor(cache): extract and encapsulate cache expiration logic

* fix: logic bug in getSimpleHTMLDOMCached

* fix: silly me, index should of course be on the key column

* silly me again, PRIMARY keys get index by default lol

* comment out the delete portion in loadData

* remove a few log statements

* tweak twitter cache timeout
 2023-07-19 05:05:49 +02:00
Dag
08d16322e1
 		fix: bug in prior conflict merge (#3546) 2023-07-16 22:37:37 +02:00
Dag
a59793e8d6
 		refactor: extract CurlHttpClient (#3532) 
* refactor: extract CurlHttpClient

* refactor

* interface
 2023-07-16 22:07:34 +02:00
Dag
310160fd92
 		feat: improve http 429 handling (#3541) 2023-07-16 07:18:38 +02:00
Dag
c9a861e259
 		fix(cache): bug in prior refactor (#3520) 2023-07-09 15:24:29 +02:00
Dag
7881c87bed
 		fix: various small fixes (#3517) 
* fix(asrocknews): Trying to get property src of non-object

Trying to get property 'src' of non-object at bridges/ASRockNewsBridge.php line 37

* refactor(http): tweak max redirs config

* fix(tiktok)

* fix(gizmodo)

* fix(craig)

* fix(nationalg)

* fix(roadandtrack)

* fix(etsy)
 2023-07-08 23:21:55 +02:00
Dag
c1c8304fc0
 		refactor: dont create multiple instances of the cache (#3504) 2023-07-08 17:03:12 +02:00
Dag
5e22459eb6
 		fix: remove unnecessary calls to purgeCache (#3502) 2023-07-06 18:52:19 +02:00
Dag
caac7f572c
 		refacor: improve cache interface (#3492) 
* fix: proper typehint on setScope

* refactor: type hint setKey()

* typehint
 2023-07-06 15:10:30 +02:00
Dag
a9fd3b9e61
 		fix(CacheInterface): logic bug in getTime (#3491) 
* fix(CacheInterface): logic bug in getTime

* test
 2023-07-05 17:37:21 +02:00
Dag
748fc9fd65
 		fix: various small notice fixes (#3474) 
* fix(patreon): php notice

* fix(pepperbridge): php notice

* fix(ebay): php notice

* fix(tiktok): php notice

* fix(yandex): fix notice

* fix(justwatch): notice

* lint
 2023-07-02 06:40:25 +02:00
Dag
ee498eadf9
 		fix: move debug mode to config (#3324) 
* fix: move debug mode to config

* fix: also move debug_whitelist to .ini config

* fix: move logic back to Debug class

* docs

* docs

* fix: disable debug mode by default

* fix: restore previous behavior for alerts

* fix: center-align alert text
 2023-06-02 20:22:09 +02:00
Dag
50865d5741
 		fix: add additional cloudflare title (Glassdoor specific) (#3342) 2023-05-11 01:33:38 +02:00
Max
c628f99928 use lowercase 2023-05-10 18:40:33 +02:00
Dag
4c3ebb312d
 		feat: improve error handling ux (#3298) 
* feat: improve error handling ux

* feat: add error messages for failed xml parsing
 2023-03-20 19:11:51 +01:00
Mynacol
4450e9b973
 		Let curl select the default HTTP version (#3249) 
This essentially reverts b042412416,
as YouTube seems to have fixed their servers.
At least I was able to query the YouTube endpoint around 150 times with
CURL_HTTP_VERSION_2TLS recently. They even advertise HTTP/3 support with
an `alt-svc` HTTP header now.

This unsets CURLOPT_HTTP_VERSION to let curl decide
on the version. This would support all curl versions and opens the
possibility for HTTP/3, but leads to inconsistent behavior depending
on the underlying curl version.

We don't set CURL_HTTP_VERSION_NONE explicitly, as it is always the curl
default and opens the path to let individual bridges override the HTTP
version where necessary.

Alternatively, setting CURL_HTTP_VERSION_2TLS explicitly would lead to consistent behavior
regardless of the curl version, but might uncover old curl bugs before the
developers enabled HTTP/2 by default.
Additionally, that requires at least PHP 7.0.7 (we require PHP 7.4
already) and curl 7.47.0 [1], released on Jan 27 2016 [2].

See also the discussion on https://github.com/RSS-Bridge/rss-bridge/pull/3249

[1] https://www.php.net/manual/curl.constants.php
[2] https://curl.se/docs/releases.html
 2023-02-22 17:48:39 +01:00
Dag
a13c4624fb
 		feat: custom http ua in AO3, fix #3188 (#3189) 
* refactor

* feat: custom http ua in AO3, #3188
 2022-12-13 09:53:42 +01:00
Dag
a5779d30b5
 		feat: add max file size to http responses (#3140) 2022-11-16 17:56:26 +01:00
Dag
2ef98b299f
 		refactor: extract frontpage to template (#3130) 
Also introduce usage of Response object
 2022-11-07 18:22:54 +01:00
Dag
e027bd9274
 		fix: improve FeedExpander (#3103) 
* fix: improve FeedExpander

Include the first libxml error in exception.

Give better error message if trying to parse the empty string.

Log all libxml errors if debug mode is enabled.

* error handling and logging tweak
 2022-10-29 10:27:02 +02:00
Dag
1f576312ea
 		feat: in debug mode, include part of http response in exception message (#3090) 2022-10-29 08:42:50 +02:00
Dag
27b3d7c34e
 		feat: improve logging and error handling (#2994) 
* feat: improve logging and error handling

* trim absolute path from file name

* fix: suppress php errors from xml parsing

* fix: respect the error reporting level in the custom error handler

* feat: dont log error which is produced by bots

* ignore error about invalid bridge name

* upgrade bridge exception from warning to error

* remove remnants of using phps builin error handler

* move responsibility of printing php error from logger to error handler

* feat: include url in log record context

* fix: always include url in log record contect

Also ignore more non-interesting exceptions.

* more verbose httpexception

* fix

* fix
 2022-09-08 19:07:57 +02:00
Eugene Molotov
bbbd599bc8
 		fix: do not throw exception on 301-303 http responses (#3014) 2022-09-06 15:40:20 +02:00
Dag
2bbce8ebef
 		refactor: general code base refactor (#2950) 
* refactor

* fix: bug in previous refactor

* chore: exclude phpcompat sniff due to bug in phpcompat

* fix: do not leak absolute paths

* refactor/fix: batch extensions checking, fix DOS issue
 2022-08-06 22:46:28 +02:00
Dag
b042412416
 		fix: force HTTP 1.1 in curl requests (#2949) 
Since curl 7.62.0 the default option is: CURL_HTTP_VERSION_2TLS

Before that the default used to be: CURL_HTTP_VERSION_1_1

Fix #2947
 2022-08-05 11:46:32 +02:00
Dag
afcc38786e
 		fix: use default headers in getContents() (#2927) 2022-07-31 04:21:56 +02:00
Jan Tojnar
5b5f3b4254
 		Do not use constants for configuration (#2938) 
* docs: Do not use constant names when referring to config options

The options are customizable using a config file and no longer hardcoded in index.php since 8ac8e08abf

* Do not use constants for configuration

Since <8ac8e08abf>, they are just set to the configuration object values.
 2022-07-24 19:26:12 +02:00
Jan Tojnar
d107f8ed30
 		Improve Factory variable names (#2895) 2022-07-06 12:14:04 +02:00
Dag
321ec7c8c1
 		refactor: move cache logic into the factory (#2884) 2022-07-05 13:20:01 +02:00
Dag
4f75591060
 		Reformat codebase v4 (#2872) 
Reformat code base to PSR12

Co-authored-by: rssbridge <noreply@github.com>
 2022-07-01 15:10:30 +02:00
Dag
07927008eb
 		refactor: CacheFactory (#2834) 2022-06-22 18:29:28 +02:00
Jan Tojnar
347f9a3eda
 		[contents] Add MIME type for mp3 (#2809) 
Without this, format tests fail on systems without `/etc/mime.types`.
 2022-06-09 22:41:10 -04:00
Dag
cb05cacd6a
 		fix: add 429 to status codes (#2757) 2022-05-27 15:25:12 +02:00
Dag
5cc34b884a
 		[core] Improve getContents docs (#2742) 2022-05-22 21:27:23 -04:00
Dag
7d00b0c5df
 		fix: include http code in exception (#2726) 2022-05-17 23:47:12 +02:00