Inside the Belly of a Search Engine

In this week we cover introductory material into the general field of web-based search engines, specifically ones that are index based. We study the basic architecture of search engines, in terms of its components and how they work together to respond to user queries. As a side effect, we discuss the implications for search engine optimisation and the reasons why highly linked web pages are generally more discoverable by search engines.

We build on the learnings in Week 1, to proceed to cover material on the information gathering procedure that search engines employ to analyse documents on the web to determine relevance to queries. Data preparation and analysis are also studied as a means of understanding how search engines match document content to queries based on a relevance model guided primarily by keyword occurrences. As an example, we delve into the mechanisms used to evaluate or compute document relevance, discover documents and rank documents in terms of relative importance with respect to search engine queries. We conclude with some further considerations to take into account with respect to how search engines operate not just in terms of textual data, but also multimedia data such as images, and videos.

Final Exam

Please provide your feedback on the course.