- Added node-html-parser as a dependency for parsing HTML content. - Implemented fetch-html script to fetch and parse HTML from a specified URL. - Updated script sandbox to allow the use of node-html-parser. - Created a new workflow for fetching data from dev.to, including configuration for URL and selectors. - Updated package.json to include node-html-parser in server package dependencies.
13 lines
264 B
YAML
13 lines
264 B
YAML
name: fetch-devto
|
|
scripts:
|
|
- script: fetch-html.js
|
|
config:
|
|
url: https://dev.to/t/productivity/top/week
|
|
selector: "#substories h2"
|
|
outputVar: titles
|
|
jsonata: "$[].text"
|
|
triggers:
|
|
- type: HTTP
|
|
method: POST
|
|
path: /fetch-dev-to
|