This job ad has been posted over 40 days ago! (*)
We are an organization working to bring transparency to and fight online censorship in China. We operate GreatFire.org which enables real-time testing of what is blocked by the Great Firewall and the most complete and updated database of URLs and keywords blocked in China. We also operate FreeWeibo.com which allows anonymous and uncensored search of Sina Weibo, the largest microblogging website in China.
Our goals are high and we have a lot to do. For this reason, we are now hiring a backend developer, specifically to help us create a better database and search solution.
You can design and manage databases holding large data volumes that grow fast. You can design indexing and caching solutions to enable fast search of large data volumes. You understand the challenges of working with Chinese-language data. You have a good overview of different open source solutions and their strengths and weaknesses.
Our project is adding tens of thousands of new records daily from various sources. Users need to be able to search these in a freetext way and also including some flags. All content is in Chinese.
We are currently using MySQL and custom indexing techniques. We need a better approach that can deal with larger data volumes (tens of millions of records, eventually more) and enable fast and accurate search of these. We may or may not continue to use MySQL depending on your advice.
You care about a free Internet and believe that such freedom depends on the actions that we take.
You don’t mind working exclusively through online collaboration.
The following skills are not required but generally valuable: Data parsing, security, networking, PHP, Chinese language.
Reach out to us on greatfire at greatfire.org (PGP key available at https://en.greatfire.org/contact) and tell us why we should hire you.