1. Forum
  2. DOVE-Net
  3. Synchronet JavaScript

  • web_feed_importer.js

    From Bill McGarrity@VERT/TEQUILAM to echicken on Mon Sep 5 10:02:00 2016
    Hiya echicken....

    I seem to be having an issue with importing one feed from: http://cdn.nhl.com/rss/news.xml

    All my other rss pages download properly. I was wondering if you can take a look at that page and see if they've done something different there or are refusing connection. I can open the url just fine in Chrome so it's got me stumped.

    Thanks!!


    --

    Bill

    Telnet: tequilamockingbirdonline.net
    Web: bbs.tequilamockingbirdonline.net:81
    FTP: ftp.tequilamockingbirdonline.net:2121
    IRC: irc.tequilamockingbirdonline.net Ports: 6661-6670 SSL: +6697
    Radio: radio.tequilamockingbirdonline.net:8010/live


    ... Look Twice... Save a Life!!! Motorcycles are Everywhere!!!
    --- MultiMail/Win32 v0.50
    þ Synchronet þ TequilaMockingbird Online - Toms River, NJ
  • From echicken@VERT/ECBBS to Bill McGarrity on Mon Sep 5 12:42:00 2016
    I seem to be having an issue with importing one feed from: http://cdn.nhl.com/rss/news.xml

    It works fine for me here. If you run the script from a shell / command prompt ('jsexec web_feed_importer.js') do you see any error messages?

    Are you adding this feed for the first time, or did you just recently notice there hadn't been any new items in a while? It looks to me like they haven't posted anything there since mid-July.

    ---
    echicken
    electronic chicken bbs - bbs.electronicchicken.com - 416-273-7230
    þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.com
  • From Bill McGarrity@VERT/TEQUILAM to echicken on Wed Sep 7 20:45:00 2016
    echicken wrote to Bill McGarrity <=-

    I seem to be having an issue with importing one feed from: http://cdn.nhl.com/rss/news.xml

    It works fine for me here. If you run the script from a shell /
    command prompt ('jsexec web_feed_importer.js') do you see any error messages?

    Are you adding this feed for the first time, or did you just recently notice there hadn't been any new items in a while? It looks to me like they haven't posted anything there since mid-July.

    web_feed_importer.js works correctly for all the other rss feeds I have listed in my modops.ini file except for the link above.

    I created a new modopts.ini file listing only:

    2nhl = http://cdn.nhl.com/rss/news.xml

    This is what I get...

    C:\sbbs\exec>jsexec web_feed_importer.js

    JSexec v3.17a-Win32 (rev 1.183) - Execute Synchronet JavaScript Module
    Compiled Sep 5 2016 05:02:42 with MSC 1800

    Loading configuration files from C:\SBBS\CTRL
    JavaScript-C 1.8.5 2011-03-31
    JavaScript: Creating runtime: 8388608 bytes
    JavaScript: Initializing context (stack: 16384 bytes)

    Reading script from C:\sbbs\exec\web_feed_importer.js C:\sbbs\exec\web_feed_importer.js compiled in 0.00 seconds C:\sbbs\exec\web_feed_importer.js executed in 0.36 seconds

    It's like it never sees either the sub or it's not reading the page correctly.



    --

    Bill

    Telnet: tequilamockingbirdonline.net
    Web: bbs.tequilamockingbirdonline.net:81
    FTP: ftp.tequilamockingbirdonline.net:2121
    IRC: irc.tequilamockingbirdonline.net Ports: 6661-6670 SSL: +6697
    Radio: radio.tequilamockingbirdonline.net:8010/live


    ... Look Twice... Save a Life!!! Motorcycles are Everywhere!!!
    --- MultiMail/Win32 v0.50
    þ Synchronet þ TequilaMockingbird Online - Toms River, NJ
  • From echicken@VERT/ECBBS to Bill McGarrity on Thu Sep 8 06:42:00 2016
    I created a new modopts.ini file listing only:
    2nhl = http://cdn.nhl.com/rss/news.xml

    Is this entry in a '[feeds]' section of your new 'modopts.ini' file?

    Reading script from C:\sbbs\exec\web_feed_importer.js C:\sbbs\exec\web_feed_importer.js compiled in 0.00 seconds C:\sbbs\exec\web_feed_importer.js executed in 0.36 seconds

    It's like it never sees either the sub or it's not reading the page correctly.

    There's no error message in there, so it's not clear that anything's actually going wrong. That's pretty much the output I would expect to see if the script doesn't find any new messages to import from the feed.

    Are you adding this feed to that sub for the first time, or was it already set up and you noticed that no new messages were coming in?

    Please try the following:

    - Create a new message area, with an internal code of 'TESTNHL'
    - Restart Synchronet or wait for the BBS to recycle
    - Add 'testnhl = http://cdn.nhl.com/rss/news.xml' to the '[feeds]' section of 'ctrl/modopts.ini'
    - Run 'web_feed_importer.js' via jsexec again

    On my end, the script takes .5 seconds to run and import all of the messages from that feed into a new message area. Subsequent executions (with no new messages to import) take anywhere from .2 to .35 seconds.

    ---
    echicken
    electronic chicken bbs - bbs.electronicchicken.com - 416-273-7230
    þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.com
  • From Bill McGarrity@VERT/TEQUILAM to echicken on Mon Jan 23 12:43:00 2017
    Hello echicken!

    Was getting something funky when I added a new sub. I ran jsexec web_feed_importer.js locally... and this is what I got...

    C:\sbbs\exec>jsexec web_feed_importer.js

    JSexec v3.17a-Win32 (rev 1.184) - Execute Synchronet JavaScript Module
    Compiled Dec 10 2016 05:02:52 with MSC 1800

    Loading configuration files from C:\SBBS\CTRL
    JavaScript-C 1.8.5 2011-03-31
    JavaScript: Creating runtime: 8388608 bytes
    JavaScript: Initializing context (stack: 16384 bytes)

    Reading script from C:\sbbs\exec\web_feed_importer.js C:\sbbs\exec\web_feed_importer.js compiled in 0.00 seconds
    Unknown scheme! 'undefined'
    SyntaxError: XML tag name mismatch (expected hr)
    SyntaxError: XML tag name mismatch (expected hr)


    A: what is Unknown Scheme! 'undefined'
    B; what's with the Syntax Error

    and

    C: NOt sure why it won't connect to this page: SYSTEMUP = http://rss.uptimerobot.com/u393104-a7daeb14e4919ab941ba59354bf80355

    SYSTEMUP I have in the Main Folder...

    Thanks in advance..

    Bill


    ... mote supports asymmetric ND mode

    ---
    þ Synchronet þ TequilaMockingbird Online - Toms River, NJ
  • From echicken@VERT/ECBBS to Bill McGarrity on Mon Jan 23 13:43:00 2017
    Re: web_feed_importer.js
    By: Bill McGarrity to echicken on Mon Jan 23 2017 17:43:19

    http://rss.uptimerobot.com/u393104-a7daeb14e4919ab941ba59354bf80355

    So, I just did a test with that feed, and it imported fine for me. No errors.

    Unknown scheme! 'undefined'
    SyntaxError: XML tag name mismatch (expected hr)
    SyntaxError: XML tag name mismatch (expected hr)

    It's possible that there was an error on the other side (at the feed provider, Uptime Robot). That 'expected hr' bit indicates that the XML parser encountered an <hr> tag, which I wouldn't expect to see unescaped/unencoded in an RSS or Atom feed. My guess is that the parser was looking at one of their error pages (404, 500, 503, etc.), which wouldn't work too well.

    ---
    echicken
    electronic chicken bbs - bbs.electronicchicken.com - 416-273-7230
    þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.com
  • From Bill McGarrity@VERT/TEQUILAM to echicken on Tue Jan 24 11:31:00 2017
    echicken wrote to Bill McGarrity <=-

    Re: web_feed_importer.js
    By: Bill McGarrity to echicken on Mon Jan 23 2017 17:43:19

    http://rss.uptimerobot.com/u393104-a7daeb14e4919ab941ba59354bf80355

    So, I just did a test with that feed, and it imported fine for me. No errors.

    Unknown scheme! 'undefined'
    SyntaxError: XML tag name mismatch (expected hr)
    SyntaxError: XML tag name mismatch (expected hr)

    It's possible that there was an error on the other side (at the feed provider, Uptime Robot). That 'expected hr' bit indicates that the XML parser encountered an <hr> tag, which I wouldn't expect to see unescaped/unencoded in an RSS or Atom feed. My guess is that the
    parser was looking at one of their error pages (404, 500, 503, etc.), which wouldn't work too well.

    if I type that address into a browser... I get this..

    <rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0">
    <channel>
    <title>Uptime Robot - All Monitors</title> <link>http://www.uptimerobot.com/</link>
    <description>Sending the status of your websites via RSS.</description> <atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" type="application/rss+xml" href="http://rss.uptimerobot.com/u1-5b5168eb2ed3396e02b6b7d4459cf634/"/> <lastBuildDate>Tue, 17 Jan 2017 02:40:46 -0500</lastBuildDate>

    I did some mkore digging and found a bad link that was causing the problems. I removed them and poof... it worked.

    Thanks for help...


    --

    Bill

    Telnet: tequilamockingbirdonline.net
    Web: bbs.tequilamockingbirdonline.net:81
    FTP: ftp.tequilamockingbirdonline.net:2121
    IRC: irc.tequilamockingbirdonline.net Ports: 6661-6670 SSL: +6697
    Radio: radio.tequilamockingbirdonline.net:8010/live


    ... Look Twice... Save a Life!!! Motorcycles are Everywhere!!!
    --- MultiMail/Win32 v0.50
    þ Synchronet þ TequilaMockingbird Online - Toms River, NJ
  • From Tracker1@VERT/TRN to Digital Man on Mon Oct 19 16:20:00 2020
    On 10/18/2020 6:13 PM, Digital Man wrote:
    evnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1:
    SyntaxError: illegal character

    What is on line 1 of the file?

    Guessing it's a BOM character sequence if loaded in a windows text
    editor and re-saved.

    --
    Michael J. Ryan
    tracker1 +o Roughneck BBS

    ---
    ­ Synchronet ­ Roughneck BBS - coming back 2/2/20
  • From Hatton@VERT/THRCORN to echicken on Tue Oct 20 07:25:00 2020
    This little test script, run via jsexec, is able to load the feed and
    print
    some articles to my terminal. Please give it a try and let me know what
    you
    see:

    Looking at the output below and comparing it to the actual XML output, I
    think the culprit here lies in elements that are expressed with "CDATA".

    Also the code references the "body" element and that does not exist in this feed, they use "description" instead.

    Reading script from /sbbs/exec/rsstest.js
    /sbbs/exec/rsstest.js compiled in 0.00 seconds
    The Onion





    ---




    ---
    <snipped for ease of reading>
    /sbbs/exec/rsstest.js executed in 0.18 seconds

    JavaScript: Destroying context
    JavaScript: Destroying runtime
    ---
    þ Synchronet þ Three Corners and Beyond! http://3corners.us
  • From echicken@VERT/ECBBS to Hatton on Tue Oct 20 08:02:00 2020
    Re: Re: web_feed_importer.js erro
    By: Hatton to echicken on Tue Oct 20 2020 11:25:14

    Also the code references the "body" element and that does not exist in this feed, they use "description" instead.

    That's fine - "body" is a property of the Item object, which is produced when parsing a feed. It's derived from an item's "description" (RSS) or "summary" (Atom) element. It's not a direct reference to an XML element.

    Looking at the output below and comparing it to the actual XML output, I think the culprit here lies in elements that are expressed with "CDATA".

    When I run that script on my system, all of the CDATA-enclosed content appears to be parsed out properly. I don't have blank lines in my output (except for 'author', which appears to be absent from their items).

    We're seeing different results, so there's some difference in the code we're running on our systems. How up to date is your BBS, including the scripts in exec/ and exec/load/?

    ---
    echicken
    electronic chicken bbs - bbs.electronicchicken.com
    þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.com
  • From Hatton@VERT/THRCORN to echicken on Tue Oct 20 13:20:00 2020
    Re: Re: web_feed_importer.js erro
    By: echicken to Hatton on Tue Oct 20 2020 12:02 pm

    We're seeing different results, so there's some difference in the code we're running on our systems. How up to date is your BBS, including the scripts in exec/ and exec/load/?

    I thought I was running latest version, I'll do a git pull and rebuild (with symlinks) and see what happens.

    Hatton

    ... File not found, I'll load something *I* think is interesting.

    ---
    þ Synchronet þ Three Corners and Beyond! http://3corners.us
  • From Hatton@VERT/THRCORN to echicken on Tue Oct 20 13:45:00 2020
    Re: Re: web_feed_importer.js erro
    By: Hatton to echicken on Tue Oct 20 2020 05:20 pm

    We're seeing different results, so there's some difference in the
    code we're running on our systems. How up to date is your BBS,
    including the scripts in exec/ and exec/load/?

    I thought I was running latest version, I'll do a git pull and rebuild (with symlinks) and see what happens.

    That was the issue - I've been doing GIT pulls and rebuilds but have not been copying over the updated JS files from exec and exec/load.

    Thanks!
    Hatton

    ... Men will always be men -- no matter where they are.

    ---
    þ Synchronet þ Three Corners and Beyond! http://3corners.us
  • From Gamgee@VERT/PALANT to echicken on Wed Oct 28 16:48:00 2020
    echicken wrote to Bob Roberts <=-

    Re: web_feed_importer.js erro
    By: Bob Roberts to echicken on Wed Oct 28 2020 08:32:21

    That would be cool. Not sure if you're thinking of creating an external RSS "door", but I really like having them imported into the message bases,

    I am thinking of that, but it would still be backed by a message
    base. There would be an RSS reader module that you could browse
    feeds from, but ultimately it's pulling data out of message
    bases. You could hide those bases from your users or not, or use
    the reader module or not. Could be a news ticker or scrolling
    newsreader, that sort of thing.

    I'd be quite interested in this also, and I'll thank you in
    advance for considering it.



    ... A day without sunshine is like night.
    --- MultiMail/Linux v0.52
    þ Synchronet þ Palantir BBS * palantirbbs.ddns.net * Pensacola, FL
  • From Sneaky@VERT/CHOICE to All on Tue Nov 3 13:22:00 2020
    Re: web_feed_importer.js erroring out
    By: Kurisu to Digital Man on Mon Oct 19 2020 02:22 am

    Hi all

    I have setup web_feed_importer.js and the one that was there when I setup
    works fine + another one I added to the list.

    I have been searching for rss feed on the internet and I like
    to ask if you could list a few rss feed that I could use on my bbs
    just all topic and bbs stuff if any

    Thank you

    Ian S 1st Choice Core Nz

    ---
    þ Synchronet þ 1st Choice Core - 1stchoicecore.co.nz
  • From Bob Roberts@VERT/HOVAL to Sneaky on Tue Nov 3 06:20:00 2020
    Re: web_feed_importer.js
    By: Sneaky to All on Tue Nov 03 2020 06:22 pm

    I have been searching for rss feed on the internet and I like
    to ask if you could list a few rss feed that I could use on my bbs
    just all topic and bbs stuff if any

    Here's what I'm using. Still playing with it. I try to find RSS feeds that have full article text, but they are harder and harder to find, especially with the news sites.

    LOCAL-HEADLINES = http://rss.cnn.com/rss/edition.rss,http://feeds.bbci.co.uk/news/rss.xml
    LOCAL-POLITICS = https://rss.politico.com/politicopulse.xml
    LOCAL-TECHNEWS = https://www.techmeme.com/feed.xml?x=1,https://TechCrunch.com/feed/,http://feeds .arstechnica.com/arstechnica/index,https://www.theverge.com/rss/full.xml

    |01bobbobbobbob|09bob|03bob|11bob|03bob|09bob|01bobbobbob |01robrobrobrob|09rob|03rob|11rob|03rob|09rob|01robrobrob

    ---
    þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.com
  • From echicken@VERT/ECBBS to Bob Roberts on Tue Nov 3 19:30:00 2020
    Re: web_feed_importer.js
    By: Bob Roberts to Sneaky on Tue Nov 03 2020 11:20:35

    Here's what I'm using. Still playing with it. I try to find RSS feeds that have full article text, but they are harder and harder to find, especially with the news sites.

    They generally want you to click through for the full story, so they can serve more ads and otherwise monetize your reading. RSS is still in use, but just isn't as good as it was 10+ years ago.

    ---
    echicken
    electronic chicken bbs - bbs.electronicchicken.com
    þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.com
  • From Sneaky@VERT/CHOICE3 to Bob Roberts on Thu Nov 5 03:35:00 2020
    Hi Bob Roberts

    to ask if you could list a few rss feed that I could use on my bbs
    just all topic and bbs stuff if any

    Here's what I'm using. Still playing with it. I try to find RSS feeds that have full article text, but they are harder and harder to find, especially with the news sites.

    yes they are hard to find, but well keep searching.

    LOCAL-HEADLINES = http://rss.cnn.com/rss/edition.rss,http://feeds.bbci.co.uk/news/rss.xml LOCAL-POLITICS = https://rss.politico.com/politicopulse.xml
    LOCAL-TECHNEWS = https://www.techmeme.com/feed.xml?x=1,https://TechCrunch.com/feed/,http: //feeds .arstechnica.com/arstechnica/index,https://www.theverge.com/rss/full.xml


    Thank you for there ones, I have a http://rss.cnn.com now and probably add more rss feed
    from there, with the one's above.

    Thank you for your reply

    Ian S 1st Choice Core Nz

    --- MultiMail/Win v0.52
    þ Synchronet þ 4th Choice Core/New Zealand