Nodejs Script to Add Rows in CSV File Through Terminal

 December 8, 2019  |  3 minutes  |  435 words  |  Talha Awan

Filling out a CSV file through Office Excel or LibreOffice Calc is easy enough, but you may find it quicker to type in fields on a terminal, particularly when you want to process the data before entry, use defaults, or keep the entry process totally mouse-free. [Read More]
csv  script 

What Are the Alternatives to Google Places Geocoding Autocomplete

 December 1, 2019  |  3 minutes  |  622 words  |  Talha Awan

After the insane price hike of Google Maps with far-reaching consequences, people are looking for its viable alternatives, including geocoding autocomplete services. We had Google autocomplete text field in one of the apps, which had some 20,000 plus autocompleted sessions a month (Google counts autocomplete by session, not per keystroke). [Read More]
google-maps  google-places 

Google Maps Price Hike, its Effect on Small And Medium Businesses, and Future Repercussions

Maps, Routes And Places; all got out of developers' reach

 December 1, 2019  |  6 minutes  |  1087 words  |  Talha Awan

For a long time, and for no fee, developers and entrepreneurs were ruthlessly milking Google Maps, the then unknown future cash cow of Google. In 2018, all of a sudden, Google put a hefty price tag on its Maps services, that included three distinct but related products: Maps, Routes, and Places. [Read More]
google-maps  google-places 

How to Run Nightmare JS On Remote Linux Server

 November 13, 2019  |  1 minutes  |  132 words  |  Talha Awan

Nightmare js is a browser automation tool. It works perfectly on local machine and even has an option to view the browser in action by passing { show: true } option when initializing Nightmare. On remote linux machine, however, it won’t work without installing and including an extra package xvfb. [Read More]
nodejs  nightmarejs  script 

How to Deal With Nightmare JS Zombie Electron Processes

Nightmare JS leaves in its wake zombie electron processes and memory leaks

 November 12, 2019  |  3 minutes  |  545 words  |  Talha Awan

Nightmare JS is a great browser automation library, especially effective for scrapping websites. It has two faults though: memory leaks and zombie electron processes. But with a duct-tape hacks we can easily overcome both. For memory leak, which is minor but builds up over time, daily restart of the node script or app is pretty effective and avoids solutions that are overkill. [Read More]
nodejs  nightmarejs  script 

Restart Pm2 Process Every Day Using A Node Script

A brute force yet effective way to restart scripts that need it

 November 12, 2019  |  3 minutes  |  618 words  |  Talha Awan

To run node js scripts and apps constantly we usually use pm2 (some prefer forever). However, some scripts require a brute force restart from time to time as they don’t fare better in uninterrupted longer runs. Mostly, the reason is memory leaks of packages you’re bound to use but have no control over. [Read More]
nodejs  pm2  script 

Trace Redirect Urls NPM Request

 November 12, 2019  |  2 minutes  |  227 words  |  Talha Awan

With NPM request module it’s quite easy to observe and trace all the intermediate urls before the final url is reached. We can do that using followRedirect option, which takes either true or false, or a function that should return a boolean value. [Read More]
nodejs  request  script 

Build Queue For Processing Webhooks With Node Js And MongoDB

Manage The Flood Of Webhooks With A Database Queue

 April 24, 2019  |  4 minutes  |  815 words  |  Talha Awan

Many of the third party services we integrate in our applications use webhooks to communicate events to us. Responding to the incoming webhook with success response (status 200) is all that’s required to acknowledge the receipt of the webhook. To process that webhook immediately upon receiving or entering it in a queue to be processed later is up to you. [Read More]
nodejs  mongodb  script