Commit Graph

40 Commits

Author SHA1 Message Date
dcb0c3386b Extractors 2025-07-29 12:47:22 +02:00
84960fe5fb FeedReaderService 2025-07-29 12:46:42 +02:00
ced2254068 Scraping Service and types 2025-07-29 12:46:20 +02:00
d8381c893d WebScraper 2025-07-29 12:45:28 +02:00
891b1e478d ContentScrapingService 2025-07-29 12:45:05 +02:00
d35416b5c8 ScrapginScheduler 2025-07-29 12:44:32 +02:00
36f6de4edd add ability to launch the scraper from package.json.scripts 2025-07-29 12:43:48 +02:00
074f66ac2b test existing and new items in batches 2025-07-29 01:50:14 +02:00
594f9bcaf8 processing multiple (a batch) should handle errors 2025-07-29 01:44:20 +02:00
c398cc9f97 test to save and to return multiple items 2025-07-29 01:24:16 +02:00
1c86ba9dc3 test to return null when saving existing feed 2025-07-29 01:21:59 +02:00
5ed38dcc98 test to save only if feed item does not exist 2025-07-29 01:19:44 +02:00
f3fffa6f88 testing if feed exists by URL 2025-07-29 01:17:56 +02:00
580dae0c4d test Scraping Service adding item to repo 2025-07-29 01:16:40 +02:00
b936697659 test try-errors checks on FeedCiount counting 2025-07-29 01:03:51 +02:00
26e8b83c87 implement counting for feed Repository 2025-07-29 01:02:35 +02:00
987b0aed3e scrapingService :: hasRepository() 2025-07-29 01:00:40 +02:00
247189661e ScrapingService :: getServiceName test 2025-07-29 00:59:43 +02:00
be1d7bff23 first implementation for ScrapingService 2025-07-29 00:57:32 +02:00
29e7b9f8e0 adding first basic test ( ScrapginService) 2025-07-29 00:57:05 +02:00
0d301f5c49 update config.ts with variables to implement rateLiiting, apiVersioning and client userAgent 2025-07-28 23:39:11 +02:00
206b5dbfa5 + adds server.ts
+ implements FeedController
+ feedRoutes.ts
+ utils/logger add server msgs
+ add port to src/config
2025-07-28 23:07:39 +02:00
b787c7dc22 removes placeholder index.ts 2025-07-28 23:05:01 +02:00
fb433cfac1 + adding hono and @hono/node-server
+ reemplazar index por server.ts
+ implement a basic server.ts in server.ts
2025-07-28 19:13:27 +02:00
0dbdc41124 feed model -> unique:true -> for safety (and to avoid mongoose warning) 2025-07-28 18:37:23 +02:00
cbe4199206 - add feed repo
- Add feed service
- Add tests for feed service
2025-07-28 18:33:16 +02:00
862c94a4e6 - update model and repository
- add tests for feed Model
2025-07-28 18:31:55 +02:00
e1b2403fed wip: mongoose - template for new Model 2025-07-28 16:41:29 +02:00
2f92684864 Feed type, first approach. 2025-07-28 16:34:33 +02:00
3981581c45 * adds complete tests for database
* adds healtCheck and connection status related methods DatabaseConnection class
2025-07-28 16:30:28 +02:00
65db950abe adds database msgs to Logger 2025-07-28 13:51:35 +02:00
d62cbb7d4b add tests for config/config and nodeEnv 2025-07-28 13:47:47 +02:00
a3df0e6650 adds nodeEnv to src/config/config 2025-07-28 13:45:16 +02:00
20c53339de * add pino dependecy and types
* implements Logger abstracting Pino
2025-07-28 13:44:45 +02:00
8c91d68b59 adds extra config/config.ts to set config/database.ts 2025-07-28 13:02:17 +02:00
069180402a adds database mongoose event hooks 2025-07-28 12:53:57 +02:00
b8dacee987 adds database class and basic tests for jest 2025-07-28 11:53:38 +02:00
5f93407ed6 adds logger under "utils" folder 2025-07-28 11:53:18 +02:00
f2acbad1fa add "Feed" files with explanation to plan some basic file structure 2025-07-28 11:52:57 +02:00
5f21982ed9 Adds gitignore, tsconfig, basic scripts and a ts hello world 2025-07-28 10:18:55 +02:00