Commit Graph

69 Commits

Author SHA1 Message Date
Ed Summers fd292f6222 fixed config file error v0.2.0 2021-01-07 21:20:36 +00:00
Ed Summers 29f416d7a4 catch http errors when fetching images v0.1.4 v0.1.5 2020-11-24 21:45:10 +00:00
Ed Summers fb914c7510 doc fix 2020-10-09 16:35:11 +00:00
Ed Summers e73f405b54 new version v0.1.3 2020-10-09 16:28:41 +00:00
Ed Summers fa175cf9c6 published_parsed is not always available, but updated is 2020-10-09 16:27:50 +00:00
Ed Summers b72a1c63df 3.3 is only required 2020-09-29 12:02:16 -04:00
Ed Summers 294bd2969f new release 2020-09-29 11:29:27 -04:00
Ed Summers a2b196bc25 fixed a stray diff boundary and reorganized imports 2020-09-29 11:28:08 -04:00
Ed Summers d75ecf5377 new release and require python3 2020-09-29 11:16:24 -04:00
Ed Summers 79be320e06 merged and resolved conflicts #18 2020-09-29 11:13:36 -04:00
Ed Summers 5515e7bd0c merged and resolved conflicts #14 2020-09-29 11:03:31 -04:00
Ed Summers 46b46ca875 merged and resolved a few conflicts #8 2020-09-29 10:51:29 -04:00
Ed Summers b5ec046f87 Merge pull request #7 from htgoebel/issue-4
Sort entries in reverse published order.
2020-09-29 10:21:01 -04:00
Ed Summers bc593134c4 Merge pull request #6 from htgoebel/issue-5
Add minimal argparse support to get support for `--help`.
2020-09-29 10:19:48 -04:00
Ed Summers 350764b352 Merge pull request #2 from stefangrotz/master
added entry.link template for some feeds (e.g. youtube-rss)
2020-09-29 10:19:24 -04:00
Hartmut Goebel 2748ac0da6 Fix: Posts published while feediverse is running are not tooted.
Fix race-condition: If a post was published within the short period of
time between fetching the RSS feed and saving the config-file, this
post was not tooted. This was caused by the timestamp in the
config-file having been the time when the file was written, not when
the feed was fetched.

I (hopefully) fixed this by storing the latest post's timestamp in the
config file. This still might cause the same issue if several feeds
are checked using the same config file.
2020-09-25 21:08:36 +02:00
Hartmut Goebel 7c7f1c049c With dry-run, print title of post.
This is to easy validation results.
2020-09-25 21:03:56 +02:00
Hartmut Goebel 60d74188c3 Enhance cleanup of fetched texts.
Remove all HTML-elements with a class "read-more" or a class matching
"read-more-*". This will remove the "Read More".
2020-09-25 19:18:47 +02:00
Steinar Bang 45897295d1 Remove hyphens ("-") from terms to avoid hashtags terminating early 2020-07-11 07:04:06 +01:00
Steinar Bang 8749618a8a Remove "." from terms to avoid hashtags terminating early 2020-07-05 08:48:24 +01:00
Steinar Bang f804a5ea57 Connect multiword terms with underscore instead of splitting the words into separate hashtags to fix #17 2020-06-24 21:40:36 +01:00
Steinar Bang f280fb0ffc Fix typo to correctly limit toot length to 500 characters, fixes #13 2020-06-15 16:15:28 +01:00
Hartmut Goebel 5945a9f9cb Add work-around for verbose-mode on non-unicode terminals. 2019-09-16 14:49:08 +02:00
Hartmut Goebel 52cf05c09c Add feed config option generator.
This allows setting or overwriting the generator provided by
the feed.
2019-09-16 14:28:45 +02:00
Hartmut Goebel 7df2d306e4 Don't crash if feed does not contain a "generator" element. 2019-09-16 14:28:45 +02:00
Hartmut Goebel 17bba74f22 Readme: Add "Special Handling for Different Feed Generators".
I should have had added this when adding the special support
for Wordpress in around e6a16dbe55.
2019-09-16 14:28:40 +02:00
Hartmut Goebel b57bc48d0d Update readme. 2019-04-23 22:44:50 +02:00
Hartmut Goebel 9e1a94d4ca Add cleaning up white-space in fetched texts. 2019-04-23 22:39:37 +02:00
Hartmut Goebel 09a3588f71 Document template element '{content}'. 2019-04-23 22:39:25 +02:00
Hartmut Goebel e41073efbc Fix template element '{content}'.
This was the same as '{summary}' and needs more attention, too.
2019-04-23 22:38:42 +02:00
Hartmut Goebel 7a5b30aeef Add option -v/--verbose. 2019-04-23 21:59:00 +02:00
Hartmut Goebel 8e51b4344d Add command line option -n/--dry-run. 2019-04-23 21:56:04 +02:00
Hartmut Goebel 0b65eb8e21 Make adding images into the toot configurable.
Add an option "include_images" into the config file.
2019-04-16 14:02:07 +02:00
Hartmut Goebel 2d45df57f1 Minor code cleanup.
Preset config values when reading config file. This is
to ease introducing new options (like the next commit
will do).
2019-04-16 14:02:07 +02:00
Hartmut Goebel e0dde90b7d On setup ask whether existing entries shall be tooted, too. 2019-04-16 14:02:06 +02:00
Hartmut Goebel b0ba30b5f3 Minor code cleanup.
Add and use helper function to ask a yes/no question.
2019-04-16 14:02:06 +02:00
Hartmut Goebel da5486d004 Fix: Mastodon allows posting 4 images max. 2019-04-16 14:02:06 +02:00
Hartmut Goebel 2624eed96b Fix: If last-updated is not given in config, no feeds are pushed.
The bug was: If last-updated was not given in the config, the current
date and time was used, inhibiting posting "old" entries.

Todo: Add an option to ask whether "old" entries shall be posted on
first run.
2019-04-16 12:07:42 +02:00
Hartmut Goebel e6a16dbe55 For wordpress skip all images provided by a plugin. 2019-04-16 12:07:41 +02:00
Hartmut Goebel d2e57bbc27 Add a work-around for buggy wordpress (urls encoded wrong). 2019-04-16 12:07:41 +02:00
Hartmut Goebel ae78c8c16f Make "content" available in the template.
Depending on the feed, the adding content could be more
appropriate. Leave this choice to the user.
2019-04-16 12:07:41 +02:00
Hartmut Goebel 03d48992c7 Add detection of premalink for wordpress-generated feeds. 2019-04-16 12:07:41 +02:00
Hartmut Goebel 350f2bca3f Add detection of feed generator and pass it for get_entry().
This allows generator-specific handling of e.g. url.

For example in wordpress `id` is an ugly url, while the
speaking permalink is stored in a alternate link
2019-04-16 12:07:40 +02:00
Hartmut Goebel 83ed532680 Add retrieving images from RSS & posting them.
Collects image urls from summary, content and enclosures
(attachments).

This add urllib3 as requirement.
2019-04-16 12:04:20 +02:00
Hartmut Goebel 5424eb2dd6 Sort entries in reverse published order.
In a feed typically the newest entries are on top, while the older
ones should be posted first. Thus reverse the order, based on
publish date.

Closes #4.
2019-04-04 15:10:50 +02:00
Hartmut Goebel 3f4d051b84 Add minimal argparse support to get support for --help.
Closes #5.
2019-04-04 15:10:39 +02:00
Hartmut Goebel 13d1dd2623 Fix deprecation warning when calling yaml.load().
This was the message: YAMLLoadWarning: calling yaml.load() without
Loader=... is deprecated, as the default Loader is unsafe
2019-03-31 00:00:54 +01:00
Hartmut Goebel 0b13bbbabe Very small code cleanup. 2019-03-31 00:00:53 +01:00
Hartmut Goebel 8886fd5d2d Remove HTML tags from content.
Do this as early as processing the entry so later steps can count
on it (esp. when counting characters)

Also add a new requirement: beautifulsoup4.
2019-03-31 00:00:53 +01:00
Hartmut Goebel fc56be6d70 Filter entries prior to processing any entry.
This saves processing time, esp. since for most installation
there should not be so many changes and most times, there will
be zero entries to be posted, thus there is not need to process them.
2019-03-31 00:00:50 +01:00