2fc4d981d1
remove unused old-style image rewritign
2013-08-02 14:04:00 +04:00
6b4617970f
add text_languagedetect to guess article language for better hyphenation
...
(bump schema)
2013-07-31 10:30:17 +04:00
0997c2bd62
Revert "add temporary hack to store original unhashed guid into cached_content for debugging"
...
This reverts commit 8096e309a5
2013-07-14 21:48:14 +04:00
8096e309a5
add temporary hack to store original unhashed guid into cached_content for debugging
2013-07-11 21:40:26 +04:00
c052e25a8b
remove unused cached_content
2013-07-10 16:55:55 +04:00
420940fa90
do not catchup newly subscribed feeds
2013-06-25 10:01:41 +04:00
6791af0cfd
pass feed it to feed_fetched and fetch_feed hooks
2013-05-20 15:28:56 +04:00
ee65bef405
add HOOK_FETCH_FEED
2013-05-20 15:26:53 +04:00
0ad2013bd2
update_rss_feed: remove unused override_url parameter
2013-05-20 15:20:14 +04:00
47673e6611
add fetch_url and owner_uid to HOOK_FEED_FETCHED
2013-05-18 09:22:06 +04:00
d1f3fa9791
try to force-convert feed data to utf8
2013-05-17 20:09:43 +04:00
fd687300bf
Revert "subscribe_to_feed: use already fetched data when updating initially"
...
This reverts commit 23923fb29b
2013-05-08 19:22:33 +04:00
23923fb29b
subscribe_to_feed: use already fetched data when updating initially
2013-05-07 15:34:20 +04:00
6f7798b643
Fixing bugs found by static analysis
2013-05-07 00:35:10 -07:00
f4ae0f053b
update: remove debugging block
2013-05-02 10:26:32 +04:00
566417c4e7
restore updstart threshold
2013-05-02 02:31:32 +04:00
5d3e5a1bb2
simplify feed cache age handling (reduce caching to sequential updates)
2013-05-02 02:30:53 +04:00
5de4010487
disable marking for the time being
2013-05-02 02:21:11 +04:00
5ef8409700
move the precautionary timestamp bumping
2013-05-02 02:20:34 +04:00
5d0d3887af
add _DISABLE_HTTP_304
2013-05-02 02:11:11 +04:00
15c762beda
updater: show owner_uid for checked feeds
2013-05-02 02:02:49 +04:00
52637d3b30
remove cache valid bailout clause
2013-05-02 01:36:17 +04:00
865a3ed6a0
change feed cache file extension
2013-05-02 01:33:02 +04:00
d4992d6b48
add support for dc:subject and slash:comments
2013-05-01 20:55:08 +04:00
ee78f81ccd
update: better tag-related debugging info
2013-05-01 20:33:59 +04:00
852d4ac890
support RDF-XML feeds
2013-05-01 20:30:52 +04:00
fd0daa9b55
remove simplepie
2013-05-01 19:14:48 +04:00
431e27851b
actually save feed xml in the cache
2013-05-01 18:10:27 +04:00
99429e57e4
remove simplepie entity decode hacks
2013-05-01 18:07:05 +04:00
b8f316dc28
change caching to save xml data, remove RDF init section
2013-05-01 17:56:21 +04:00
04d2f9c831
add basic rss support
2013-05-01 17:38:16 +04:00
cd07592c29
add basic tinyparser/atom
2013-05-01 17:04:57 +04:00
65c8d5e76d
update: set last_updated to now() when process starts
2013-05-01 15:43:56 +04:00
39ede9862f
experimental: decode numerical utf entities on import in entry title
2013-04-29 16:59:36 +04:00
efe46a3b53
Merge pull request #167 from KonishchevDmitry/pr-allow-slash-in-filter-regex
...
Allow slashes in filter regular expressions
2013-04-27 02:10:27 -07:00
7b80b5e160
Match each tag separately against user filter regular expression
...
Each article's tag should be matched against user filter regular
expression separately. Current matching confuses when you want to match
an exact tag. You suppose to write "^tag$", bug now have to write
"(^|,)tag(,|$)" which is very inconvenient and requires knowledge about
how do you process this matching.
2013-04-26 16:30:25 +04:00
ffa1bd7b19
Allow slashes in filter regular expressions
...
User's regular expressions need escaping before passing them to
preg_match()
2013-04-26 15:46:48 +04:00
90e5f4f1de
base if-modified-since on last received article, not feed update timestamp
2013-04-25 18:42:48 +04:00
23283f11a3
fetch: better checking for 1970- date
2013-04-25 16:12:49 +04:00
aafd55bab6
do not needlessly mark icons as failed
2013-04-24 19:01:51 +04:00
84ceb6bd2e
fix floicon failed message not respecting debugging setting
2013-04-24 16:48:47 +04:00
e2cf81e214
unify houskeeping stuff, increase spawn interval
2013-04-24 14:54:59 +04:00
654650857f
reduce daemon chattiness a bit
2013-04-24 14:26:05 +04:00
8cabc200d5
increase updstart locking interval to prevent concurrent updates; decrease batch size for the daemon
2013-04-24 14:23:38 +04:00
fce451a4f7
fix updating for pgsql
...
increase default batch size
remove random check between feedbrowser or update task executing
2013-04-24 13:43:40 +04:00
81c2066345
updating: do not use cache timestamp if it is unusable for current feed;
...
sort chronologically instead of random
2013-04-24 13:21:40 +04:00
6ee0d4b05c
do not recalculate avg color repeatedly
2013-04-23 22:37:06 +04:00
560cbd8c0d
attempt to recalculate favicon avg color if it changes
2013-04-23 22:33:23 +04:00
36490f11a3
add a hack so that if floicon fails on some icon, it won't be processed again
2013-04-23 22:30:06 +04:00
1134497129
Fix doubly applied basepaths to lockfiles.
2013-04-19 21:25:26 +02:00
68cccafcad
remove debug_enabled global
2013-04-19 13:42:40 +04:00
9ec103525d
update_rss_feed: simplify debug reporting
2013-04-19 13:26:10 +04:00
ebec81a6fb
subscribe: verify XML before adding to the database; fetch: try to work around entity problems if initial parsing fails
2013-04-19 13:17:28 +04:00
1367bc3f5e
trim received feed data on fetch
2013-04-19 12:35:30 +04:00
96db9a14d9
do not try to calculate icon avg color if GD is not present
2013-04-19 08:42:35 +04:00
ce2b219c64
entry_author: do not double escape string, author & comments: trim
2013-04-18 16:25:02 +04:00
1ffe3391f9
make pluginhost a singleton
2013-04-18 12:27:34 +04:00
52d88392da
move db-prefs to OO
2013-04-18 12:00:01 +04:00
3f6f085769
add better gzdecode support for php native fetch, use curl under open_basedir
2013-04-18 11:36:13 +04:00
d0d86316ee
Revert "do automatic gzcdecode on feed data"
...
This reverts commit aea03558bb
2013-04-18 11:19:25 +04:00
aea03558bb
do automatic gzcdecode on feed data
2013-04-18 09:15:55 +04:00
48cb253625
get_article_filter: fix missing argument
2013-04-17 19:25:15 +04:00
a42c55f02b
fix blank character after opening bracket in function calls
2013-04-17 18:34:18 +04:00
7440a7fe3c
daemon2: use passthrough to daemon-loop
2013-04-17 18:19:28 +04:00
6322ac79a0
remove $link
2013-04-17 16:48:41 +04:00
857efe49e6
add schema checking to feed updating and update script
2013-04-17 12:10:35 +04:00
e2261e177b
implement old log entry purging in update_daemon_common; add some more error types; tweak error log display
2013-04-16 20:34:20 +04:00
5e3d5480f7
use hashed guids in a hopefully backwards compatible fashion
2013-04-15 19:28:11 +04:00
bc7a144dd5
properly remove and replace favicon color when favicon gets manually removed/uploaded
2013-04-15 18:22:48 +04:00
12a6bd28ac
remove hsl stuff from classes/feeds, we take care of this when choosing the color
2013-04-15 17:07:06 +04:00
6ac722d5b1
try to improve color guessing algorithm a bit
2013-04-15 17:01:51 +04:00
63c323f736
only enable colored favicons in vfeeds; fix RGB triplet packing
2013-04-15 15:17:12 +04:00
687a4f59c8
store favicon color as #rrggbb; process existing favicons
2013-04-15 15:08:00 +04:00
2cfbb448fb
Added average color calculation of feeds' favicons for banded display.
2013-04-15 12:28:52 +02:00
044cff2d74
implement basic feed authentication parameter encryption in the database (FEED_CRYPT_KEY)
2013-04-13 18:24:41 +04:00
c5569ff8d3
decode html entities in article title on import
2013-04-12 16:30:40 +04:00
3306daecf4
implement upload-related support for open_basedir
2013-04-11 19:12:00 +04:00
5929a0c1e4
updater: prevent duplicate feed ids being scheduled for update
2013-04-04 13:20:44 +04:00
32b7a340ad
Merge branch 'master' into tunable-fetches
...
Conflicts:
include/rssfuncs.php
2013-04-01 16:05:48 +03:00
8401101d50
Moved hard-coded fetch timeout values into config file to allow site-level tuning
2013-04-01 15:08:21 +03:00
5e736e4592
implement stop action
2013-03-31 19:28:36 +04:00
ee0542ce28
daemon: do not schedule user-disabled feeds (2)
2013-03-31 14:36:06 +04:00
cd7ebb39e4
daemon: do not schedule user-disabled feeds
2013-03-31 14:24:13 +04:00
e81610d9ef
daemon: sort by random
2013-03-30 16:28:21 +04:00
8292d05b7c
daemon: show feeds/minute stats
2013-03-30 16:25:10 +04:00
17e74b21cf
update_rss_feed: bailout if cache is considered valid, but older than last_updated
2013-03-30 15:42:27 +04:00
31623bfa99
if-modified-since: also take last_updated into account
2013-03-30 15:35:16 +04:00
7a01dc776e
support If-Modified-Since
2013-03-30 15:12:20 +04:00
7b11aa80ab
Revert "Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)"
...
This reverts commit bca1cfbb95
2013-03-30 13:26:15 +04:00
bca1cfbb95
Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)
2013-03-30 09:43:37 +01:00
0d6943b097
Revert "order feeds selected for update randomly"
...
This reverts commit 13b33a3fc3
2013-03-29 17:25:07 +04:00
13b33a3fc3
order feeds selected for update randomly
2013-03-29 15:36:40 +04:00
32b05702ff
daemon: do not show feed urls twice
2013-03-29 14:32:11 +04:00
30ac8d1f86
update: exclude feeds with disabled updates
2013-03-29 12:31:53 +04:00
1c4421fcd7
experimentally rework update daemon to process all feeds with the same url sequentially to minimize network access and better utilize caches
2013-03-29 12:21:40 +04:00
4f9cbdff1d
cache simplepie object instead of xml feed data
2013-03-29 11:50:58 +04:00
d5974daa33
remove feed update interval debugging
2013-03-29 11:32:22 +04:00
f074ffe945
cache downloaded feed data to minimize network access
2013-03-29 11:31:10 +04:00
ca5ff2d9fb
Remove 2 useless line breaks. One got printed even with --quiet.
2013-03-28 20:30:06 +01:00
be574731fc
modify sorting by date_entered: set date_entered per-batch; use updated as a secondary criteria
2013-03-27 13:34:04 +04:00
30123fe630
Handle future pubDate
...
Posts with pubDate in the future always appear at the top, which is ruining the
whole "newest at top" idea. One way to handle this is to use time() instead.
This is what google reader does and seems reasonable.
2013-03-25 18:49:11 +02:00
a3a896a127
let us rejoice on being able to create double negative filters (refs #631 )
2013-03-25 19:46:43 +04:00
227d5e4168
label auto matcher: preg_quote() label
2013-03-24 22:49:43 +04:00
9811276da7
rssfuncs: do not try to match on empty label
2013-03-23 09:23:02 +04:00
3972bf5981
db_escape_string: specify link parameter for consistency; sessions: do not force-close db connection in _close()
2013-03-22 09:14:55 +04:00
f0bd8e6531
rework image caching to work without permanent article content rewriting (refs #582 )
2013-03-19 09:25:36 +04:00
f935d98e5d
properly fix the cache_images issue (refs #578 )
2013-03-19 00:42:59 +04:00
7873d58822
implement proper last_marked/last_published feeds for proper sorting of
...
published and marked virtual feeds, remove sorting by last_read
workaround
api: add pubsubhubbub ping when article is being set published
bump schema
2013-03-17 15:38:21 +04:00
1f45c8571f
fix escaping of entry content being broken by cache_images() rewriting
2013-03-16 18:50:13 +04:00
8349a32e75
remove cache_content remnants
2013-03-16 16:11:58 +04:00
cc38c8e549
remove LIBXML_NOEMPTYTAG because of double <br/>s - the #357 issue with
...
htmlpurifier might not be relevant anymore because of htmLawed switch,
but <br/>s are annoying
2013-03-16 16:07:11 +04:00
96f98cb091
escape fetch error message before saving in the db ( closes #550 )
2013-03-11 14:14:28 +04:00
41acdf4c11
remove purging of inactive feeds in daemon_common (causes duplicates)
2013-03-07 09:03:42 +04:00
f161869541
when purging inactive feeds, set last_updated to NOW()
2013-03-04 21:49:14 +04:00
be17885789
pluginhost: add get_debug()/set_debug() for plugins to detect if debugging is allowed
2013-02-26 19:30:19 +04:00
70caff4811
done collecting data debug message: remove title
2013-02-26 19:26:38 +04:00
5321e775f9
remove update on checksum change (updated status has been removed); rtl stuff (unused)
2013-02-26 19:20:58 +04:00
5d56d100f1
force disable simplepie unnecessarily sanitizing data
2013-02-26 18:27:40 +04:00
2ea09bdef6
update_daemon_common: purge inactive/not updated feeds
2013-02-26 16:16:04 +04:00
ada103f234
simplepie init: hide errors
2013-02-23 18:47:05 +04:00
5de51df7f8
rssfuncs: show fetch done debug message in appropriate place
2013-02-23 18:42:14 +04:00
ab457a9c96
rssfuncs: load pluginhost stuff properly
2013-02-23 18:40:48 +04:00
017401ddce
implement HOOK_FEED_FETCHED
2013-02-23 18:38:50 +04:00
e02555c1b8
add af_* plugin workaround for already processed article
2013-02-23 12:07:46 +04:00
b30abdadd2
prevent article filters from modifying article GUID; add separate plugin_data field for this
2013-02-21 22:24:06 +04:00
750cfcd2fa
remove processing of ttrss_feeds.icon_url
2013-02-08 17:19:43 +04:00
0a3fd79b0e
fix image caching not working on plugin-rewritten content; remove content cache stuff
2013-02-04 13:00:50 +04:00
87d7e8507a
split some more functions from functions.php
2013-01-22 22:32:17 +04:00
c5e3995f8c
disable content caching if _FEEDS_CONTENT_CACHE is not enabled
2013-01-22 16:12:50 +04:00
3a4c897382
force separate data in ttrss_entries between users
2013-01-18 17:50:18 +04:00
ba946ba276
use force_feed()
2013-01-10 11:04:05 +04:00
9e222305f7
allow plugin modification of article guid
2012-12-30 12:22:29 +04:00
455b1401cd
properly load user plugins and data on update
2012-12-30 11:33:13 +04:00
bb566dc263
fix overflow of various 250 char fields in rssfuncs
2012-12-26 22:06:47 +04:00
d2a421e3cb
more work on user-selectable plugins; properly process system and user plugins
2012-12-25 10:02:08 +04:00
f16116834e
split digest stuff into digest.php
2012-12-24 15:52:59 +04:00
356a991a7b
update_rss_feed: escape error string immediately
2012-12-24 14:17:24 +04:00
4412b877d0
implement HOOK_FEED_PARSED, add example plugin (refs #424 )
2012-12-24 14:13:03 +04:00
fa6fbd3659
do not preg_match() tags from article content
2012-12-24 13:56:36 +04:00
1b35d30c1f
prevent escaping of article link in the database when using simplepie (refs #472 )
2012-12-24 13:53:38 +04:00
19b3992b78
remove magpie, fix article filter plugins
2012-12-24 13:45:34 +04:00
19c7350770
experimental new plugin system
2012-12-23 14:52:18 +04:00
83e6e313be
support comments on simplepie properly
2012-12-22 13:43:48 +04:00
35cb2b8f67
Revert "support comments for simplepie"
...
This reverts commit d020a86c36
2012-12-22 13:41:13 +04:00
d020a86c36
support comments for simplepie
2012-12-22 11:33:03 +04:00
2bbd699475
update: feed escaping issue
2012-12-16 13:38:50 +04:00
2a91b6ff78
add built-in expiring of obsolete lockfiles
2012-12-12 09:46:02 +04:00
d5e9cf28f1
remove uid from ccache guid prefix
2012-11-29 14:56:05 +04:00
765509c572
create separate guids for cached and authorized content to prevent unnecessary data sharing
2012-11-29 14:55:03 +04:00
8054439f47
wait a bit before initial content fetching
2012-11-26 14:52:18 +04:00
Andrew Dolgov
Andrew Dolgov
Rasmus Lerdorf
Andrew Dolgov
Dmitry Konishchev
Daniel Andersson
moontear
Barak Korren
all
Joschasa
saperduper