Pages

Total Pageviews

Showing posts with label Dams. Show all posts
Showing posts with label Dams. Show all posts

Monday, 20 July 2015

My Foray into CartoDB

 One of the significant milestones of self learning this year was developing web maps using CartoDB.

My profile for CartoDB (https://daneshchacko.cartodb.com/maps)


I first learned about CartoDB through the Spatial Vision training (during the IMIA AP 2014 Conference). In this blog post, I will explore the ups and downs of using CartoDB for web map visualization

Why CartoDB? Up to 2015, the only online GIS platform I am accustomed with is ArcGIS Online. However, I would like to brush up my skills on new areas such as CartoDB. If you look at my profile above, I have developed around 6 maps for various topics .

If you want to design simple maps without much tweaking, CartoDB is easy tool to deploy web maps. They continuously improve the options for you to have for symbology or labelling. One thing that sets apart CartoDB and ArcGIS Online (from my personal experience) is the customization of the tools available in CartoDB.

If you have good programming and web design knowledge, you can exponentially enhance the experience of CartoDB maps. Let me give you a good example. Refer to this link: Sarawak Electoral Visualization

Example 1: Electoral Visualization

I was exploring myself on how to visualize electoral issues of the delimitation exercise in Malaysia. What started out as my personal hobby project, it evolved into a fully embedded map for my NGO's Homepage (http://www.tindakmalaysia.org/)

Referring to the link (Sarawak Electoral Visualization), basic tools of CartoDB weren't of much help. As I proposed CartoDB map to my NGO, they were happy to take onboard on the idea. However, my NGO has placed some expectations on the contents to be shown. After sourcing the datasets from my NGO, I was tasked to show the interrelationship between electoral seat category, representation value and its correspondence to local boundaries.

While it sounds simple, the basic tools of CartoDB could not meet the criteria of the symbology needed (i.e. the representation value or showing the symbol of administrative boundaries). I spent a significant amount of time to research html codes and examples of CartoDB to bring the source codes needed for the  visualization.

Subsequently, with close collaboration with my NGO, I spent additional time in writing out the correct terms for the legend and other necessities for the map to be understandable. Finally, I embedded the map of my NGO's website and customize the right size for the embedding. The default embedding option of CartoDB would result of compression of items in the layout.

Example 2: Time Based Visualization

Similar to ArcGIS Online, CartoDB has ventured into time based visualization (now with new enhancement). For only point based data, Torque (and Torque with category) allows the CartoDB users to visualize time based changes (which is becoming a big trend in maps). I previously designed on ArcGIS Online (and Mango Map) a static map of all the dam locations in Malaysia. It was built on intense research every possible freely available information back in 2013.

Referring to the link (Malaysian Dams), one of the big challenges I faced initially was the original dataset did not have proper timestamp needed for CartoDB. Preferably, in your shapefile or data file, the timestamp should have proper date or date-time format. I have created this dams dataset two years ago for static map and pop-up purposes.

The second challenge was the cleaning-up of classification. It was found through CartoDB upload there were duplicate classification values (i.e. Dams/Irrigation, Dams / Irrigation). I spent some amount of time in removing the duplicates in QGIS.

Since CartoDB torque visualization works for point based data (for the moment), I chose Torque with category to visualize the construction (opening date) history of 70+ Malaysian Dams and categorized them with the purposes. This allows the user to see where the dams are being constructed and see what types of dams are being related. I customized Torque category to show cumulative changes (as dams are rarely taken down). Choosing a suitable base map was another of challenge of its own as you want your content to be the Figure.

I did spend additional time to produce a understandable symbology for the dam purposes. I will be making further changes to make it more distinguishable. The rest was history. CartoDB Torque tool worked very well and now charting history of dams.

Conclusion

CartoDB has been a great tool with steep learning curve. My advice is before you embark on CartoDB maps, do consider your level of html experience and willingness to spend time, energy and (if necessary) money to develop the map. CartoDB email support is Great! They are swiftly respond to support enquiries.

Tell me your CartoDB experience...

Monday, 11 March 2013

Malaysian Dams Portal (2)


View Larger Map

ArcGIS link for the malaysian dam portal
Faster Link: http://www.arcgis.com/explorer/?open=dafa5301fe734943a8c2d593c89dfd8e
Any form unauthorized edits would disqualify me of any inaccuracy charges and claims. Edits that I perform will be notified in the blog. Click on the map, then proceed to more details, then in the detail section, click open in arcGIS Explorer Online to see the full map. Or, go to the hyperlink above for the direct page.
New Update on the dashboard have been inserted on 13/3/2013
Wherever there is a request of information statement, I appeal to users to find the information from reliable sources (With evidence too) to fill the remaining gaps. This same applies if you can information on other dam locations not shown in the map.

Saturday, 23 February 2013

Malaysian Dams Portal




For separate link and better preview,
http://bit.ly/13xDEEY

Disclaimer: I, Danesh Prakash Chacko, as the producer of the map fully credit the various sources of data that identified both the locations and attributes of the dams. This included government sites, engineering companies, UTM copyrighted thesis, blogs and news sites. I hereby disclaim the ownership of the data found in the map portal.
Anyway the map portal should be used for study, research and personal use. No way it should be referred as a commercial source or tool for advanced analysis as the accuracy of the data could be questionable.

Introduction
From controversial 12 Dam project in Sarawak to water crisis in Selangor, water and dam issues has surfaced as hot political debates across the political spectrum. With the emergence of the idea of all development is good, dams plays both positive and negative role in sustainable development. The plan to make Sarawak into renewable energy hub have met stiff resistance among the indigenous communities as mass population displacement would occur. Meantime, in Selangor, political parties are squabbling on whether Selangor has enough water for its own needs or not and grand plan to bring water from nearby dam in Pahang (Kelau Dam) plus Langat 2 issue. Whilst the post would not highlight the issue thoroughly, I have decided the first step of awareness of water issues is to create information portal about dams.

The Malaysian Dams Portal highlights roughly around 90 dams in Malaysia, both constructed and proposed ones. The 'Portal' show where there are distributed, the purpose, the capacity, completion year and installed electricity capacity. Let me clarify on the accuracy of the spatial and attribute data of the dam. The dam locations were identified through Google Maps, FAO articles and other university or government publications. The dam locations were mapped out on a scale of 1:200 000 where the coordinates represent the location of the dam walls (if not, the centre of the reservoir at rare instances). Since the dam wall is big and some inaccuracies exist in coordinates, the map position of the dam could be off from 30 to 100 metres from any point of the dam wall. For the case of 12 proposed Sarawak dams and new Sabah dams, the accuracy of the location is very coarse. They were mapped out at the scale of 1:500 000 to 1:1 000 000. Pointing back to the disclaimer, it should be used as a guide, not a business or serious analytical tool.

You might observe where some sections on the 'notes' stating 'Request for Other Information'. This is because some of the dam attributes could not be identified at all. I am appealing to the readers and users of the blog and portal to contribute authoritative sources to fill the gaps. Having said that, please drop your queries on my blog to address the missing or questionable information.

As much as possible, usage of Wikipedia is limited to 10% of the data collected. The next section list out all the sources I have compiled for the dam location and attributes.

Limitations
Please drop in your queries on mistakes, what extra information should be added, better web map portals or others on the blog. This web map service is powered by online GIS Mango Map. I am considering to do this similar portal on ArcGIS Online to have more interactivity (though initial attempts have failed). If it works, I will post as a separate links.

Sources:
I would like to acknowledge fully the information sources:
Major:
-JPS Malaysia (Department of Irrigation and Department)
-Suruhanjaya Perkhidmatan Air Negara
-Sarawak Integrated Water Resources, http://www.siwrs.com.my/modules/iwrm/page.php?id=8&menu_id=0&sub_id=3
-FAO, faolex.fao.org/docs/texts/mal99051.doc
- Mohd Azizi bin Ya-Habib Thesis (2011), 'A study on inspection and monitoring structure dam in Malaysia, Case study dam owned JPS Malaysia' - Property of Universiti Teknologi Malaysia (UTM)
Minor:
-http://teochiewkia2010.blogspot.com.au/2010/02/penang-water-usage.html
-http://lsan.kedah.gov.my/index.php?option=com_content&view=article&id=107&Itemid=82
-http://www.mada.gov.my/empangan
-http://www.acssb.com.my/acssb/pdf/Publication-1.pdf
-http://books.google.com.au/books?id=Mi5w01UByyoC&pg=PA517&lpg=PA517&dq=klang+gates&source=bl&ots=SFhwNpkXX2&sig=Bb3oHPHfMasr2r6br8wMPD5NeOU&hl=en&sa=X&ei=25ERUYrrKu6fiAfukIGwAQ&ved=0CGwQ6AEwCw#v=onepage&q=klang%20gates&f=false
-http://peterchin.my/?p=2111
-Puncak Niaga Sdn Bhd
-http://sahabatroselle.blogspot.com.au/2012/11/amaran-banjir-sungai-selangor-kuala.html
-http://www.sspsb.com.my/ws/brochure/SSP_WS_ID8_BATU%20HAMPAR.pdf
-http://wikimapia.org/3881754/Kawasan-tadahan-Hulu-Juaseh
-http://www.utusan.com.my/utusan/info.asp?y=2008&dt=0801&pub=Utusan_Malaysia&sec=Timur&pg=wt_01.htm
-http://www.epu.gov.my/html/themes/epu/images/common/pdf/papers/txtspeech.pdf
-http://sos-selangor.org/?p=71
-http://www.sinarharian.com.my/edisi/terengganu/banjir-benteng-empangan-paya-peda-terpaksa-dipecah-1.115426
-http://www.ketara.gov.my/empangan-paya-peda
-http://www.kujie2.com/isu-semasa/projek-empangan-hidroelektrik-hulu-terengganu-puah-dam.html
-http://terengganulening.blogspot.com.au/2009/10/empangan-baru-di-terengganu.html
-http://www.bharian.com.my/articles/TerengganucadangbinaempanganminihidrobekalelektrikuntukTNB/Article/
-http://daruliman.wordpress.com/2010/05/06/kerja-kerja-awal-empangan-hidroelektrik-kedua-sedang-berjalan/
-http://bm.harakahdaily.net/index.php/headline/16619-empangan-ulu-telom-tenggelamkan-7600-hektar
-http://www.smec.com/Default.aspx?aProjId=488
-http://www.smecmal.com.my/projects_detail.php?subaction=showfull&id=1196946935&archive=&start_from=&ucat=4&
-http://www.kettha.gov.my/content/penswastaan-bekalan-air-empangan-bengoh-urusan-negeri-kata-chin
-http://www.gerik.gov.my/web/guest/pelancong/empangan_pong
-http://gis.doe.gov.my/eia2/Upload_folder/Ex_Sum/MOA-PayaPedaES-Jan2010.pdf
-http://www.tbnsa.gov.my/image/image_gallery?uuid=8b1d3dbb-cb16-4690-950d-d1bc29437e89&groupId=167079&t=1315794731081
-http://mrkumai.blogspot.com.au/2012/09/tips-melawat-cameron-highlands-empangan.html
-http://cdm.unfccc.int/filestorage/_/i/UV7NBCQ4IW2H0G1KSE5P9D3X8F6RLY.pdf/7664-PDD-10%20Oct%2012.pdf?t=aXR8bWlnejgzfDC06yqp5OjtjzoQ3BbIpIv8
-http://www.doe.gov.my/portal/wp-content/uploads/EJ423-Jeniang-Ringkasan-Eksekutif.pdf
-http://www.unescap.org/esd/environment/infra/suncheon/documents/Case_studies/LABUAN-Water-Infrastructure.pdf
http://www.townplanning.sabah.gov.my/iczm/reports/Coastal%20Profile%20Sabah/Figures/Figure%2066%20Locations%20of%20Power%20Stations%20in%20Sabah.gif
-http://wargamarhaen.blogspot.com.au/2012/09/empangan-tambatuon-bn-pinggir-suara.html
-http://www.scribd.com/doc/45160104/Upper-Padas-Hydroelectric-Project-1
-http://sabahkini.net/index.php?option=com_content&view=article&id=1360:tenom-pangi-hydro-power-enigma&catid=35:berita-sabah&Itemid=27
-http://indigenouspeoplesissues.com/index.php?option=com_content&view=article&id=4196:background-information-on-kaiduan-dam-in-sabah-
-http://www.freemalaysiatoday.com/category/nation/2011/03/15/villagers-protest-against-proposed-kaiduan-dam/
-http://starstorage.blob.core.windows.net/archives/2008/7/23/nation/n_01sarawakdams.jpg
-http://www.malaysiakini.com/news/212042
-http://www.stop-corruption-dams.org/resources/Sold_down_the_river_BMF_dams_report.pdf
-http://www.efka.utm.my/thesis/IMAGES/3PSM/1992/JHH1/norazmee5.pdf (Property of UTM)