I am building a web application that in short is taking fairly poorly structured data in SQL Server and via Node.JS porting it over to MongoDB. The reason I need this is that I need access to data from a fairly poorly written application that is central to an organization that I do not have ability to change code on from which the initial data is getting entered on. Once translated, I can have my application do what the business is looking for.
Right now my application is polling SQL Server every 30 minutes for changes and then updating my MongoDB via Node.JS, and due to the volume of data, it is undesirable to poll much more frequently.
What I need to happen is to have real time notifications from SQL Server pushed to my Node.JS application in some way whether active or passive no Node.JS's end so that it can update my Mongo database.
The node library I am using to get the data is: https://github.com/patriksimek/node-mssql
A few possible ideas I had were:
- Have SQL Server send out a notification of some kind to my NodeJS HTTP service endpoint
- Have NodeJS run a streaming query that will run on my end each time changes are made
- Write an application in C# that watches these changes and pushes them to my NodeJS HTTP endpoint.
There are a few out there that seem to talk about this, but most seem to talk about changes on the data source origination point (which I cannot change), not from SQL Server itself.