Map Data Visualization

This post is about what I have learned about visualizing data from 2019nCov-api. In order to visualize the data I will need to get the latitude-longitude reference. And I found two interesting APIs. Baidu Map vs Google Map. The coordinate systems is actually quite interesting. Baidu Maps uses a variant of web Mercator projection for slicing map data into tiles with an underlying latitude-longitude reference - BD-09 coordinate system while the Chinese government is using GCJ-02.
Read more →

AWS Resources Visualizer | yUML | Boto3 | Python

This is an example about how to use aws boto3 with yUML to visualize your aws cloud resources. Please feel free to 👉📱message my twilio bot +447479275693.I will come back to you shortly 😃. In my last post, I have talked about how to play with aws boto3 api. During a usual dev-ish-ops day, sometimes I need to draw an aws network diagram. I have to log in to the console, click click click, and then copy-paste…hmmmm…It’s a little tiny bit boring and obviously, I want to automate it.
Read more →

Text Mining | NLTK | Python

In my previous posts, we have crawled some articles and news through RSS feed and HTML tags. We played with google’s nlp api and then as a developer without too much pocket money to play with. You end up looking for cheaper and better alternatives 👉nltk (natual language toolkit). Let’s break the sentence down and let your code to define how will it read 🤓 How about let the code understand your emotions and 👉 you to the grammar mistake you made.
Read more →

Text Mining | Google NLP | Python

So I have complained about the Google’s Spreadsheets API. After I crawled the news, I feel like I should do some text mining to break the sentences down and teach my algo to read the news. And I came across Google’s NLP API, Ha! I know I won’t like it but why not?

  1. let’s create a google-nlp class # Imports the Google Cloud client library from google.cloud import language from google.
Read more →

Web Scraper | Python

For the Golang version please check here. And here is a python version: """create a rss class to parse the rss feed url anf get the title and link """ import feedparser import os class rss: def init(req, url): req.url = url def fetchDetails(req): try: url = req.url last_etag = '' last_modified = '' title = '' link = '' row = '' result = [] feed = feedparser.parse(url) last_etag = feed.
Read more →

AWS | Boto3 | Python

This is an example about how to create your own python boto3 class and use it in your day-to-day work 😃. Please feel free to 👉📱message my twilio bot +447479275693. I will come back to you shortly 😃. import boto3 import os """how to use this classimport aws_modules.get_all_sg_rulessg_rule = aws_modules.get_all_sg_rules.sg(aws_account) # passing aws_account value to retrive all sg rulessg_rule_result = sg_rule.getSgRules()""" class sg: def init(req, aws_account): req.aws_account = aws_account def getSgRules(req): try: os.
Read more →