Exploratory Data Analysis on Welcome

Recent resale flat sales

Sat, 13 Nov 2021 00:00:00 +0000

Dataset

Dataset retrieved as usual from Singapore’s public data. Only data after 2017, in the towns of Queenstown, Bukit Merah, and Clementi are displayed in the graph below.

Interactive graph

(This has been removed temporarily as it is too large)

Process

Data cleanup
Learning basic JavaScript to write callbacks to filter dataset in Bokeh graph, inspiration here
Not the most optimized and will be slow to reload due to having to loop through dataset with the filter

What data does TraceTogether really track?

Fri, 10 Apr 2020 00:00:00 +0000

TraceTogether

In the midst of the COVID19 crisis, the Singapore government has developed an app called TraceTogether, on which much ink has already been spilt. The goal of the app is to aid in contact tracing by keeping track of people you might come into close contact with unknowingly (for example, on the train, at a hawker center) via tracking bluetooth signals. I won’t go into more detail on how the app works or on privacy concerns since those are not really my areas of “expertise”, but merely be content with examining the data collected in my TraceTogether app.

Which boat should my rowing club buy?

Sun, 15 Mar 2020 00:00:00 +0000

Dataset

As one of the resident data scientists of my rowing club, I decided to play a little with the data generated by boat booking over the year 2019. Data was collected from a shared online Google Sheets file, where members wrote down their names for the boat they intended to use and the date/time where they were rowing. Since this analysis was done, stricter logging policies were implemented (standardizing names used by members by forcing the choice to be made from a drop down list, and enforcing full list of crew names for crew boats), so next year’s of data analysis should be less painful! Of course, this dataset doesn’t take into account those with private single boats - they appear on the sheet only when they row in crew boats.

How much does it rain in Singapore?

Sun, 15 Sep 2019 00:00:00 +0000

Dataset

Real time weather data can be retrieved from this API provided by NEA and the Singapore government and is available for free. We have air temperature, rainfall, windspeed, and wind direction data.

Data can only be fetched day by day or for a specific timestep through this API. It is pretty simple to write a quick script to request data from the API using Python’s “requests” library. Data is returned in json format and subsequently converting the data into a pandas dataframe just takes a little more work (a naive conversion into a dataframe results in two columns: one for the timestamp and one where the entry for each timestep is a list of dictionaries of the form {“sensor id”: xx, “value”, yy}).

What do Singapore's electricity prices look like?

Sat, 31 Aug 2019 00:00:00 +0000

Dataset

The following data is retrieved from the Energy Market Company website and is available for free.

This dataset comprises of the 2018 Uniform Singapore Energy Price (USEP) as well as the overall demand in Singapore in MW, among other variables that are not shown below. Data is available in half hourly periods. The USEP is here in $/MWh, and is determined by the demand and supply of the electricity market of the period in question.