Motivation
[反正债多了不愁,再开个方向。]
Data plays a core role in most business systems, data storage and retrieval tasks seem plain to regular application developers, even managers, while how to connect or link data to gain more interesting patterns(more technically, data mining) is still roughly hard. Many data processing and analysis frameworks try to solve giant data volume problems, this note is dedicated to record features of data structuring problem in data mining, and pay more attentions on representation, storage, navigation of relationships in data models.
Audience
myself, who also are interested in semantic web techniques.
Scope
support a descriptive running example
linked data concepts
linked data application based on semantic web techniques
find a clue to use Neo4j in semantic web techniques or linked data
Related Notes
Apache Jena Fuseki notes
Progress
2015/06/26 initial plan
2015/06/27 1-5: introduction, FOAF, SPARQL, etc: need review
2015/06/28 6-7: RDFa and RDF storage
2015/06/29 Related Notes - Fuseki
Content
5-star scoring system of Linked Data: P.4
The DBpedia project(http://dbpedia.org) extracts this structured data from Wikipedia
articles and puts it on the Web.
Linked Data has one amazing property: it may be easily combined with other
Linked Data to form new knowledge.
Another useful feature of Linked Data is that it’s self-documenting.
Linked Data is no silver bullet. It won’t protect you from issues of data quality or
from service failures.
Linked Data principles
see more in Tim Berners-Lee's thoughts on Linked Data principles
The Linking Open Data(LOD) project
The LOD project 4 is a community activity started in 2007 by the W3C ’s Semantic Web Education and Outreach (SWEO) Interest Group. The project’s stated goal is to “make data freely available to everyone.”
commonly used RDF prefixes: P.40
RDF formats
RDF in the web
Media types:
RDF Format | Preferred Content-Type | Alternative Content-Type |
RDF Turtle file | text/turtle | |
RDF/XML file | application/rdf+xml | |
RDFa | text/html | |
JSON-LD file | application/ld+json | application/json |
OWL file | application/owl+xml | application/rdf+xml |
N-Triples | application/N-Triples | text/plain |
file types and web server
publishing RDF content using Apache HTTP servers:
swbp-vocab-pub
platforms
Linked Data platforms or Semantic Web products, for example Callimachus, see semanticweb tool and sw wiki tool for more products,
In using structured data, you’re enabling machine readability and indexing of this data.
In interlinking published data on the Web, you’re enabling reuse of your information.
a Question: is President Barack Obama a Star Wars fan?
tools for finding distributed Linked Data
Product DB aims to be the World’s most comprehensive and open source of product data.
Its data including ProductWiki, MusicBrainz, DB pedia, Freebase, and OpenLibrary, and is gathered by search engines’ crawl sites that publish GoodRelations RDFa or Open Graph protocol data in their pages; for example, or example, BestBuy, IMDb, and Spotify.
Mozilla add-ons: RDFa Developer
You can use the outcome of SameAs.org to help identify a canonical URL for a given item. A canonical URL is the best URL among available choices.
example: use the Python scripting language, RDFLib, and html5lib to access the RDF a data available from Best Buy for a sample product, the Darth Vader Alarm Clock Radio.
install python modules:
$ sudo pip install rdflib
$ sudo pip install html5lib
core code snippet:
import rdflib
import html5lib
graph = rdflib.Graph()
result = graph.parse('http://productdb.org/gtin/00681326152002.ttl', format='turtle')
bestBuyGraph = rdflib.Graph()
bestBuyResult = bestBuyGraph.parse('http://purl.org/net/BestBuyDarthVaderClock', format='rdfa')
Each SPARQL SELECT query is organized as follows:
types of SPARQL queries
depedia: an online playground
sample queries:
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
PREFIX dbprop: <http://dbpedia.org/property/>
select ?location
where {
?person rdfs:label "George Washington"@en.
?location dbprop:namedFor ?person
}
LIMIT 100
Query using Apache Jena ARQ:
JENA_HOME> ./bin/arq --query ./bin/query/location.rq
JENA_HOME> ./bin/arq --query ./bin/query/location.rq --results JSON
Seriously, you should reference [1] as a second try with SPARQL.
windfalls:
Online map generator Google Static Maps
purpose: provide semantic meaning to web content and enable the extraction of Linked Data. This enables your website to be both machine- and human-readable.
RDF in Attributes(RDFa) is a language that allows you to express RDF data within an HTML document.
Specifications:
RDFa 1.1
HTML+RDFa 1.1, Support for RDFa in HTML4 and HTML5
Tool: RDFa 1.1 Distiller and Parser
<!DOCTYPE HTML>
<html version="HTML+RDFa 1.1" lang="en">
<body id="me"
prefix="
rdf: http://www.w3.org/1999/02/22-rdf-syntax-ns#
rdfs: http://www.w3.org/2000/01/rdf-schema#
xsd: http://www.w3.org/2001/XMLSchema#
dc: http://purl.org/dc/elements/1.1/
foaf: http://xmlns.com/foaf/0.1/
rel: http://purl.org/vocab/relationship/
stars: http://www.starwars.com/explore/encyclopedia/characters/">
RDFa attributes in HTML5 tags:
GoodRelations is the most widely used RDF vocabulary for e-commerce. It enables you
to publish details of your products and services in a way that search engines, mobile
applications, and browser extensions can utilize the information and improve your click-through rates.
GoodRelations website
GoodRelations' concept model wiki
Schema.org is a collaborative initiative by three major search engines: Yahoo!, Bing, and Google.
Its purpose is to create and support a common set of schema for structured data markup on web pages
and to provide a common means for webmasters to mark up their pages so that the search results
are improved and human users have a more satisfying experience.
RDF extracted from the RDF a-enhanced HTML files can be queried using SPARQL.
TODO: programming procedures not using RDFa 1.1 Distiller and Parser.
RDF dataset in W3C technology stack
RDF abstract view:
RDF as a generic, graph-based data model that represents data in the form of triples. These triples are records containing three values (subject, predicate, object) containing ( URI , URI , URI ) or ( URI , URI , value)
relational DB implemented RDF store:
Category | Description |
*Vertical(triple)table stores* | Each RDF triple is stored directly in a three-column table (subject, predicate, object). |
*Property(n-ary)table stores* | Multiple RDF properties are modeled as n-ary table columns for a single subject. |
*Horizontal(binary)table stores* | RDF triples are modeled as one horizontal table or into a set of vertically partitioned binary tables where each individual table represents an RDF property. |
Commonly used triplestores:
omitted :-)
W3C's index of Converter to RDF tools
description:
integrate data from CSV/XML returned web service and local file
tools:
References
[1] Hebeler J, Fisher M, et al. Web 3.0与Semantic Web编程[M]. 清华大学出版社, 北京.2010.
[2] Wood D., Zaidman M., Ruth L., et al. Linked Data: Structured data on the web[M].Manning Publications Co.: 2014.