Tell us about the code on your site with Code Search Sitemaps

By Bram Moolenaar, Software Engineer

We've heard from a number of site owners who want to make sure their public source code is searchable via Google Code Search. To help with that, we extended the Sitemap Protocol to support code files. This makes it possible to specify all the code files on your site, as well as the programming language and software license for each file.

To get started, check out the new Code Search tags for Sitemaps. For complete software packages that are archives (.tar, .tar.gz, .tar.bz2, or .zip), you can create a packagemap file to describe all the individual code files in each package. For example:

  <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
          xmlns:codesearch="http://www.google.com/codesearch/schemas/sitemap/1.0">
  <url>
     <loc>http://example.com/download/myfile.c</loc>
     <codesearch:codesearch>
         <codesearch:filetype>C</codesearch:filetype>
         <codesearch:license>LGPL</codesearch:license>
     </codesearch:codesearch>
  </url>

  <url>
     <loc>http://example.com/download/myproject.tgz</loc>
     <codesearch:codesearch>
         <codesearch:filetype>archive</codesearch:filetype>
         <codesearch:license>Apache</codesearch:license>
         <codesearch:packagemap>packagemap.xml</codesearch:packagemap>
     </codesearch:codesearch>
  </url>
  </urlset>

Once you've created your Sitemap, post it to a public URL on your site and then be sure to submit it through Google Webmaster Tools.

We hope this effort will help make even more code accessible and useful for developers. Let us know what you think. There's still a lot more code out there, so we'll keep working on improving Google Code Search as a tool for finding it.

Read More

Improvements to Google Code Search

By Aleksander Fedorynski, Software Engineer

When I first came to Google, I was curious (and anxious) to learn what project I'd be working on. I was pleasantly surprised to find out that I'd be helping build Google Code Search. I felt like a penguin assigned to work on Herring Search -- even more so because the project involved searching with regular expressions, a non-trivial problem to get right. We launched Code Search last October, enabling search over billions of lines of public source code. Today we made some updates to Code Search that will hopefully make it even easier to find the code you're looking for.

First, we've expanded our crawl to include not just complete archives and repositories, but individual code files and sample code snippets from webpages as well. Now when you search for things like [LFractalCanvas] or [nph-refresh], you'll have a better chance of finding what you want. Second, we've made a few ranking adjustments, such as putting class and function definitions closer to the top for a lot of searches. Lastly, Code Search is now available in domains outside the United States, from my home country of Poland, to Brazil, China, France, Germany, Italy, Japan, Korea, the Netherlands, Russia, and Spain, to name a few.

We hope you'll continue giving us feedback on ways to improve Code Search. There's a lot of code out on the web, and we've still got a lot of work left to make it all accessible and useful for developers everywhere.

Read More