OGP Products
logo

Data.gov.sg

We make Singapore's open government data discoverable, understandable, and usable. Consistently co-creating valuable data with government agencies to empower people to innovate and make informed decisions.

SINCE 2015

Active
Product screenshot

Product Overview

Team Members

11

PM

5⅔Engineer

2Design

Ops

arif-avatarfoong-avatarakash-avatarkhant-avatarraisa-avatarryantan-avatarsihan-avataryongjie-avatarjueling-avatarsamlee-avataribrahim-avatar

Cost Per Quarter

$951,108
Show breakdown

Usage

176K

Sessions

407K

Page views

-16%
311M

Automated downloads (API calls)

+9%
199K

Manual downloads

+31%

Initiative level metrics

1.89M

Google Impressions

+66%
34,800

Google Clicks

+71%
622K

Searches

4.5%

Searches with no results

Satisfaction

4.04/ 5

Public user satisfaction

3.15/ 5

Admin user satisfaction

Key Highlights

Q3 2024 Jul-Sep

  • Key Features Added:

    • Removed beta prefix from the url
    • Updated the Real-Time API dataset details page for API querying within the user-interface, added API schemas, status codes and examples
    • Added map-based visualisations on Mapbox for GeoJSON datasets, providing previews of the data and metadata viewers on the user-interface
    • Optimised core web vitals on both desktop and mobile to ensure optimised user experience (>90% good URLs and 0% bad URLs)
    • Deprecated legacy products, saving ~9.9K USD per month, migrated from Open Search to Typesense, saving ~3k USD per month
  • Metrics:

    • Decrease in page views due to changes in the user journey wherein users may now browse datasets directly on the search results page
    • Removed internal data sharing platform metrics due to scheduled deprecation on 31st Dec 2024
    • Added intermediate metrics to measure progress towards search and discovery of data.gov.sg
    • Switched from Single Ease of use Question to User satisfaction scores to measure overall user satisfaction with data.gov.sg from a scale of 1 (lowest) to 5 (highest)

Q2 2024 Apr-Jun

  • Key Features Added:
    • Revamped the data.gov.sg platform, including the adding of data reuse and usage metrics on the landing page
    • Added semantic search, filters, sorting and redesigned search to a split view for easier browsing of datasets
    • Implemented a new dataset details page, including a dataset preview, filtering and API code snippet for querying of datasets via the platform apis
    • Added a data viewer for viewing of sample data, including the summary statistics on categorical variables and null values, as well as filtering and search capabilities
  • Metrics:
    • Backdated download metrics since Q1 2024 (changed from 193k to 123k) to correct for a miscalculation due to internal API calls for the real-time API datasets

Q1 2024 Jan-Mar

  • Key Features Added:
    • Added caching to datastore APIs, resulting in an 80% reduction of API call volume to the server
    • Write APIs deployed to allow government agencies to automate their data uploading workflow
  • Growth:
    • Added NEA’s real-time weather readings for lightning forecasts
  • Metrics:
    • Q1 2024 infrastructure costs were previously reported as $96707, but have been corrected on 10th Jul 2024 to $191919 to include additional product costs

Q4 2023 Oct-Dec

  • Key Features Added:
    • Ability to generate API keys
    • Scaled up API infrastructure to handle higher QPS and reduce CPU load
    • Deployment of write APIs for automated data ingestions
  • Growth:
    • Implemented datastore for E-Gazette Website (https://www.egazette.gov.sg/)
    • Automated integration with Singstat using Singstat Table Builder APIs
    • Upgraded integration infrastructure with NEA to message queues

Q3 2023 Jul-Sep

  • 100% Human traffic migrated
  • 100% Charts migrated
  • 91% API traffic migrated
  • Scheduled deprecation of metadata APIs for Q4
  • Shut down legacy.data.gov.sg application
  • Added the API calls from real-time APIs to the metrics
  • Key Features Released:
    • Launched the admin panel, Admins now able to create, edit, publish and unpublish datasets
    • Admin OTP login implemented
    • CSV ingestion and validation based on canonical data formats (SGDRM)
    • Metadata APIs (dataset/collections listing and metadata) released

Q2 2023 Apr-Jun

  • Rewrote public application for data.gov.sg and launched the beta
  • 46% Human traffic migrated
  • Key Features Released:
    • User interface redesign, including landing page, search and dataset pages
    • Migration away from CKAN data infrastructure towards modern AWS stack (DynamoDB, RDS, S3)
    • Upgraded read API infrastructure
      • Deployment of backwards compatible read APIs (96% of total API traffic)
      • Testing of upgraded metadata APIs (4% of total API traffic)
Built by
OGP Logo
LinkedIn Logofacebook LogoInstagram Logo
©2024 Open Government Products
0 COMBO