Click to edit Master title style

NIEM Ontologies and Vocabularies

Transforming NIEM to RDF/OWL and Querying NIEM-compliant Instance Data using SPARQL and SPIN
SemTech 2011 East, Thursday, December 1, 2011, 3:00 PM - 3:50 PM Level: Technical Intermediate Location: Auditorium Ralph Hodgson, CTO, TopQuadrant Gokhan Soydan, Semantic Solution Developer, TopQuadrant

Copyright 2011 TopQuadrant Inc

What is there to talk about, Click to edit Master titleis style there enough time?
Business and Technical Motivations Approaches to model-based Information Exchange using controlled vocabularies
Reusable Message Building blocks Composable Message Schemas Controllable Vocabularies Linked Data Information Insight
UML XML Schema UN/CEFACT CCTS OWL XML Schemas OWL and Turtle/JSON-LD

Take Away

Expressing NIEM as OWL Models and Vocabularies

The Power of RDF/OWL and SPARQL Next Possibilities
Copyright 2011 TopQuadrant Inc

XSD to OWL Transformation U.S. DOJ Logical Entity Exchange Specification 3.1 (LEXS) XML Instance Messages to RDF Conversion

SPARQL inferencing over LEXS Messages Demonstration NIEM as LOD

2

First lets remind ourselves on: why information is exchanged

Sculpture by M. Chava Evans (Baltimore, MD) Sculpture, Studio 33, Torpedo Factory, Alexandria, VA

Copyright 2011 TopQuadrant Inc

technical motivations
OWL as a specification language for information models and controlled vocabularies

UML? XML

OWL
Copyright 2011 TopQuadrant Inc

Sculptures in the National Gallery, East Building, Washington DC, Nov 25, 2011

But life in the XML Ecology isnt easy

from hierarchies

to Graphs

from Graphs to hierarchies

Copyright 2011 TopQuadrant Inc

more at http://topquadrantblog.blogspot.com/2011/09/living-in-xml-and-owl-world.html

Co-existence of OWL and XSD/XML

1
Make OWL Schemas from NIEM and LEXS XSD Schemas

Some breakthroughs: Click to edit Master title style

XSD XSD XSD RDF/OWL Convert XSD to RDF/OWL TopBraid RDF/OWL Convert XSD to RDF/OWL Transformers TopBraid RDF/OWL
TopBraid Transformers

Convert XSD to RDF/OWL Transformers

Use the OWL Schemas to make RDF from LEXS XML Messages

+
Copyright 2011 TopQuadrant Inc

XML

Convert XML to RDF/OWL Semantic XML

RDF/OWL

+
6

Click to ReportingHub edit Master title style Semantic Processing

RDF/OWL

XML
XML
Convert RDF/OWL to XML

RDF/OWL
Convert XML to RDF/OWL

SPARQL Rules (SPIN)

SPARQL Rules (SPIN)

RDF/OWL
HTML
Convert RDF/OWL to HTML

SPARQL Web Pages (SWP)

HTML

PDF
Convert HTML PDF SPARQL Web to Pages (SWP)

Copyright 2011 TopQuadrant Inc

Generating Schemas and Controlled ClickXML to edit Master title style Vocabularies from OWL Models

Going from XML to OWL

GRDDL XSLT Generator XSLT Processor

ref: XML SchemaPlus http://www.xspl.us

Copyright 2011 TopQuadrant Inc

Different Reasons to Connect the Dots Click to edit Master title style
1) 360 Degrees View
More about the same thing A

2) Transitive Connections
B C

What is linked to a thing of interest

3) Information Discovery
A

Find things that share common attributes or relationships

9

Copyright 2011 TopQuadrant Inc

Personal Motivations: Click to edit Master title style August 1, 2009 Data Independence Day

www.oegov.org
Copyright 2011 TopQuadrant Inc 10

Current practices for Living in the XML Ecology raise many challenges:
1. Vocabulary Alignment
2. Governance of core models 3. Extensibility and tailoring of models to local needs 4. Resilience to change

Copyright 2011 TopQuadrant Inc

11

Some ways XML Message Schemastitle havestyle been, Click to edit Master or are being, made using UML (1 of 5)

Take Away

The Weather Data Model

No URIs No inherent aggregation properties Special programs Complex queries

ref: WXXM 1.1 Primer, 1.1 10 February 2010, https://wiki.ucar.edu/display/NNEWD/WXXM
Copyright 2011 TopQuadrant Inc 12

Some ways XML Message Schemastitle have style been, Click to edit Master or are being, made using UML (2 of 5) 2

Take Away

CIM Models in the SmartGrid

ref: EPRI CIM and 61850 Harmonization 2009 Project Report, Nov 17, 2009, http://cimug.ucaiug.org/Meetings/Charlotte2009/Presentations/CIM%20and%2061850%20Harmonization%20102909.pdf

Copyright 2011 TopQuadrant Inc

13

Some ways XMLto Message Schemas title have been, Click edit Master style or are being, made using UML (3 of 5)

Take Away

Harmonizing Spatial Data NEN 3610:2011 and GML

UML Application Schema model (XMI)

UML

Guidelines

ShapeChange (Java,program) (Java Servlet)

Encoding Rules Configuration (XML)

GML Application Schema (XML Schema)

No URIs No inherent aggregation properties Special programs Complex queries

ref: http://www.nen.nl/web/Normshop/Norm/NEN-36102011-nl.htm
Copyright 2011 TopQuadrant Inc 14

Some of the ways Message Schemas have Click toXML edit Master title style been, or are being, made using UML (4 of 5)

Take Away

UN/CEFACT Standards for Message Exchange

/ No URIs No inherent aggregation properties Special programs Complex queries

Source: 16th UN/CEFACT PLENARY http://www.unece.org/fileadmin/DAM/cefact/cf_plenary/plenary10/UNCEFACT%2016TH%20PLENARY_full_rev5.ppt

Copyright 2011 TopQuadrant Inc

15

Some ways XML Message Schemas have Click to edit Master title style been, or are being, made using UML (5 of 5)

Take Away

NIEM Information Exchange Package Documentation

/ No URIs Complexity Recommended Practices Required Practices

source: Where have all the Standards Gone?, Bruce Kelling (Moderator), http://www.ncja.org/Content/NavigationMenu/EducationEvents/2009NationalForum/AllSpeakers.Standards.ppt Copyright 2011 TopQuadrant Inc 16

TopQuadrant has faced the OWL co-existence with UML and XML challenges on a number of projects
The Netherlands MoJ Ontology-Driven Metadata Workbench Message Builder

NASA Telemetry and Command, Simulation and Data Architecture Models and Vocabularies
SmartGrid Semantic Harmonization and Interoperability

EPIM Reporting Hub for the Norwegian Oil and Gas Fields

Copyright 2011 TopQuadrant Inc

17

The Netherlands MoJ Ontology-Driven Click to edit Master title style Metadata Workbench Message Builder
Business Needs
Accurate and rapid Information Sharing between Organizations Agility in response to Legislation Changes Data Quality is guaranteed Reduced Costs of Message Schema Development

Take Away

Technical Benefits

Direct and flexible Reuse of Data Components Full Automation of XML Schema creation Semantic Consistency is preserved and confirmed Linked Data / traceability Version Management
ref: http://www.enterprisedatajournal.com/article/netherlands-ministry-justice-metadataworkbench-composing-xml-message-schemas-owl-models.htm

Copyright 2011 TopQuadrant Inc

18

The Netherlands MoJ Ontology-Driven Click to edit Master title style Approach to Message Design using UN/CEFACT Solution: Ontology-Based Metadata Workbench:

Take Away

Transform Domain Models into UN/CEFACT CCTS compliant representation and allow Business Analysts to assemble business documents for electronic messages from Component Parts.

Copyright 2011 TopQuadrant Inc

19

Creation of XML Message Schemas Click to edit Master title style

Rich Ontologies
Projects Contexts
Domains

Take Away

CCTS Ontologies
Business Document Ontologies Business Component Overlay Core Component Overlay
CCTS Document
CCTS Document Editor

CCTS-Compliant XML Schemas are generated from the XSP Document

CCTS XML SchemaPlus

CCTS XML Schema

SPIN Transformation rules

XSP Generation

XSD Generation

CCTS MetaModel Rich Ontologies are expressive models of domains. These include LKIF and detailed situations of law and legal document and procedures.

XSP MetaModel

XSLT Script

Acronyms
BIE CCTS Business Information Entity UN/CEFACT Core Component Technical Specifications Legal Knowledge Interchange Format SPARQL Inferencing Notation XSL Transformations (XSLT) Version 2.0 XML SchemaPlus

Users create CCTS documents from BIEs and Core Components

LKIF SPIN XSLT XSP

Copyright 2011 TopQuadrant Inc

20

Click to edit Master title style NASA Constellation Program

Constellation Program Data Architecture and Interoperability through the use of OWL Ontologies with strategies for co-existence with XML and other data formats.
CxP 70160 ANX10 Infrastructure Specification CxP 70160 ANX11 Application Programming Interface Specification CxP 70160 ANX14 Policy and Security Model

Take Away

Copyright 2011 TopQuadrant Inc

21

Generating XML Schemas and title Controlled Click to edit Master style Vocabularies from OWL Models

Take Away

Going from XML to OWL

GRDDL XSLT Generator XSLT Processor

ref: XML SchemaPlus http://www.xspl.us

Copyright 2011 TopQuadrant Inc

22

Click to edit Master title style ReportingHub Vision

Need:
Reporting to authorities and partners on the NCS in a cost efficient and secure manner

Take Away

Outcome:
Improved Information Integration and Exchange Faster and better decisions

Enablers:
A Field Specific Asset Model based on the Common Asset Model ISO 15926, PCA RDL and NPD Facts
XML

RDF/OWL

PDF
Convert RDF/OWL to PDF SPARQL Web Pages (SWP)

SPARQL as a way to query the data in a triple store and reason about data using appropriate inference engine(s) Web Services for hiding the complexity of SPARQL Queries Machine driven creation of new data relationships without restructuring the data model

HTML

RDF/OWL
Convert XML to RDF/OWL

PDF
Convert HTML to PDF SPARQL Web Pages (SWP)

SPARQL Rules (SPIN)

1500 named users, and 100 concurrent users

Copyright 2011 TopQuadrant Inc 23

ReportingHub Click to edit Master title style Semantic Processing

RDF/OWL

Take Away

XML
XML
Convert RDF/OWL to XML

RDF/OWL
Convert XML to RDF/OWL

SPARQL Rules (SPIN)

SPARQL Rules (SPIN)

RDF/OWL
HTML
Convert RDF/OWL to HTML

SPARQL Web Pages (SWP)

HTML

PDF
Convert HTML PDF SPARQL Web to Pages (SWP)

Copyright 2011 TopQuadrant Inc

24

The NIEM/LEXS Experiment

Copyright 2011 TopQuadrant Inc

25

The Click NIEM/LEXS to edit Master Experiment title style

LEXS Instances

From NIEM/LEXS XSD Schemas and Instance Data

LEXS Rules

LEXS Ontology

NIEM Ontologies

To OWL Models and RDF Triples

NIEM Vocabs and Datatypes

DTYPE

VAEM, VOAG, VOID, DC

NIEM/LEXS RDF/OWL Stack

Copyright 2011 TopQuadrant Inc

26

Click toWhat edit Master is NIEM? title style

National Information Exchange Model, NIEM, is an interagency initiative to provide the foundation and building blocks for national-level interoperable information sharing and data exchange. The NIEM project was formally announced at the Global Justice XML Data Model (Global JXDM) Executive Briefing on February 28, 2005. It was initiated as, and continues to be, a joint venture between the U.S. Department of Homeland Security (DHS) and DOJ with outreach to other departments and agencies. The base technology for NIEM is derived from the Global JXDM.
Copyright 2011 TopQuadrant Inc

source: http://it.ojp.gov/default.aspx?area=implementationAssistance&page=1017&standard=486

27

Options for implementing information exchanges

An Information Exchange Package (IEP) is an XML representation of the information shared for a specific business purpose. An Information Exchange Package Documentation (IEPD) is a collection of artifacts (describing the purpose, structure and content of IEPs) that governs an information exchange.
Copyright 2011 TopQuadrant Inc source: US DoJ Implementation Guidance for NIEM-Conformant Exchanges , http://www.hsdl.org/?view&did=487388 28

What areMaster IEP and title IEPD? Click to edit style

What we will show you today

Generation of OWL Models from XML Schemas Auto-conversion of LEXS-based XML messages to RDF An experiment with fake (generated) Incidents data to show how multiple messages can be aggregated Some SPARQL Queries and SPIN rules at work
Copyright 2011 TopQuadrant Inc 29

XSD/XML to OWL Rules (1 of 2) Click to edit Master title style

#
1 2

Take Away

XSD/XML Constructs
xsd:simpleType xsd:simpleType with xsd:enumeration owl:Datatype

OWL Constructs
Becomes an owl:Class as a subclass of EnumeratedValue. Instances are created for every enumerated value. An instance of Enumeration, referring to all the instances, is created as well as the owl:oneOf union over the instances. owl:Class owl:Class owl:Class and subclass of the class generated from the referenced complex type

3 4 5

xsd:complexType over xsd:complexContent xsd:complexType over xsd:simpleContent xsd:element (global) with complex type

6
7

xsd:element (global) with simple type

xsd:element (local to a type)

owl:Datatype
owl:DatatypeProperty or owl:ObjectProperty depending on the element type. OWL Restrictions are built for the occurrence.

Copyright 2011 TopQuadrant Inc

30

XSD/XML to OWL Rules (2 of 2) Click to edit Master title style

#
8 9 10

Take Away

XSD/XML Constructs
xsd:group xsd:attributeGroup Anonymous Complex Type

OWL Constructs
owl:Class and sub-class of A_AbstractElementGroup owl:Class and sub-class of A_AbstractAttributeGroup As for Complex Type except a URI is constructed from the parent element and the nested element reference. Also, the class is defined as a subclass of A_Anon. As for Simple Type except a URI is constructed from the parent element and the nested element reference. Uses dtype:defaultValue to attach a value to the OWL restriction representing the associated property.

11 12

Anonymous Simple Type xsd:default on an attribute

13

Substitution Groups

Subclass statements are generated for the members. Instance files resolve their types by consulting the OWL model at import-time. OWL Annotation properties are created and placed directly on the relevant class.
Become, based on user selection, dc:description, rdfs:comment and/or skos:definition OWL annotations. Overrides the schema type with the specified type.
31

14
15 16

Annotation attributes on elements

Annotations using xsd:annotation xsi:type on an XML element

Copyright 2011 TopQuadrant Inc

DEMO of XSD to OWL and XML to OWL Transformations

Copyright 2011 TopQuadrant Inc

32

Metrics on the NIEM OWL Model

Take Away

SELECT ?class ?restrictionCount WHERE { ?class a owl:Class . BIND(smf:countResults( "SELECT DISTINCT ?property WHERE { ?class rdfs:subClassOf ?restriction . ?restriction a owl:Restriction . ?restriction owl:onProperty ?property }" ) AS ?restrictionCount ) }

Copyright 2011 TopQuadrant Inc.

Slide 33

NIEM Person (Proto) OWL Model

Take Away

Note: to address the reusability required in the MoJ work, NIEM Person was re-factored into individual Details classes.
Copyright 2011 TopQuadrant Inc. Slide 34

Refactoring of NIEM Person into an OWL Model with reusable Concepts (person:Details)

Take Away

Depending on the context of use, concepts describing different details about a person can be selected for the UBL Business Documents and Messages.
Copyright 2011 TopQuadrant Inc. Slide 35

Refactoring of the NIEM Person into an OWL Model with reusable Concepts (person:AppearanceDetails)

Take Away

A persons Appearance Details will be needed for criminal investigations.

Copyright 2011 TopQuadrant Inc. Slide 36

NIEM JXDM Complex Type Example

Take Away

Copyright 2011 TopQuadrant Inc.

Slide 37

DOJ Logical Entity Exchange Specification (LEXS)

Copyright 2011 TopQuadrant Inc

38

Click What to edit is the Master DOJ title LEXS? style

LEXS provides a flexible, NIEM-based framework used for the creation of NIEM-conformant IEPDs for information sharing, both for publishing information and for system-to-system federated searches.
LEXS is a family of NIEM-conformant IEPDs that define flexible structures to support a variety of applications.

Any application that participates in OneDOJ, is a part of LEISP, or supports law enforcement information sharing must participate in LEXS exchanges.
If additional structures beyond the

base LEXS are required, LEXS should be extended by using NIEM (Option 2).

Copyright 2011 TopQuadrant Inc

source: http://it.ojp.gov/default.aspx?area=implementationAssistance&page=1017&standard=486 39

Conversion XMLtitle Schema to OWL Clickof toLEXS editfrom Master style using the TopBraid XSD to OWL Importer
XML Schemas OWL Models

Copyright 2011 TopQuadrant Inc

40

Using Click SPARQL count the properties on the to to edit Master title style LEXS/NIEM OWL Models

SELECT ?class (COUNT (DISTINCT ?p) AS ?properties) WHERE { ?class a owl:Class . OPTIONAL { ?class rdfs:subClassOf ?r . ?r a owl:Restriction . ?r owl:onProperty ?p . } } GROUP BY ?class ORDER BY DESC( ?properties )

Copyright 2011 TopQuadrant Inc

41

digest:EntityAssociationType really Click to edit Master title style stands out with 194 Properties

Is this a refactoring opportunity?

Copyright 2011 TopQuadrant Inc 42

Click to edit Master title style Some NIEM Controlled Vocabularies

FBI

Copyright 2011 TopQuadrant Inc

43

Click to editExample: Master title style FBI Code Lists Hair Color
OWL Model OWL Instances

Grey Hair in Turtle Syntax

fbi:HAICST_GRY a fbi:HAICodeSimpleType ; rdfs:label "GRY"^^xsd:string ; dtype:order "5"^^xsd:nonNegativeInteger ; dtype:value "GRY"^^xsd:token ; skos:definition "Gray or Partially Gray"^^xsd:string ; skos:prefLabel "GRY"^^xsd:string .
44

Copyright 2011 TopQuadrant Inc

The Click digest:EntityActivity to edit Master title Class style

OWL Class with properties Note that the proto-OWL ontology respects the XML Schemas use of wrapped data types. An optimization can unfold these to direct data types

Inheritance

Association

Association Multiple Inheritance is common

Copyright 2011 TopQuadrant Inc

A digest:EntityActivity is both a digest:Entity and a digest:EntityActivityType

45

A digest:EntityActivity Instance Click to edit Master title style

Take Away

<lexsdigest:EntityActivity> <lexsdigest:Metadata s:id="MIncident1"> <nc:ReportedDate><nc:Date>1997-03-12</nc:Date></nc:ReportedDate> </lexsdigest:Metadata> <nc:Activity s:id="Incident1" s:metadata="MIncident1"> <nc:ActivityIdentification><nc:IdentificationID>000000000003</nc:IdentificationID> </nc:ActivityIdentification> <nc:ActivityCategoryText>Incident</nc:ActivityCategoryText> <nc:ActivityDate><nc:DateTime>1997-03-12T00:01:00.0Z</nc:DateTime></nc:ActivityDate> <nc:ActivityDescriptionText>On 3/12/1997 at 12:01 a.m., Mr. Donald R. Duck (Witness 1) saw a white male break the glass of his neighbor's (Jacob Joe) front door. Mr. Duck placed a 911 call on his cell phone to report the incident. Within minutes, police arrive at the residence (1 NW Brockway Avenue) to find the subject ransacking the house. Detective Bond was the responding and arresting officer. The subject was taken to the Santa Fe Police Department and placed under arrest. An arrest report was filed on 3/12/1997.</nc:ActivityDescriptionText> </nc:Activity> </lexsdigest:EntityActivity>

Class

Instance

Copyright 2011 TopQuadrant Inc

46

Transforming Click to edit LEXS Master Instance title Data style to RDF
burglary-incident-warrest-basic-lexs.xml

Automatic Conversion from

burglary-incident-w-arrestbasic-lexs (RDF)

LEXS XML to RDF

XML

RDF/OWL
Convert XML to RDF/OWL Semantic XML

TopBraids Semantic XML Engine uses sxml:tag annotations on the

auto-generated NIEM/LEXS OWL Ontologies to control the transformations.

Copyright 2011 TopQuadrant Inc

47

1 Triples Useful QA Check on the Semantic XML Click to edit Master title style

1 Semantic

XML is a composite pattern model:

?anElement composite:child ?anotherElement ?anElement composite:child ?anAttribute

QA Check

SELECT * WHERE { ?subject composite:child ?object . NOT EXISTS { ?object a sxml:Comment } NOT EXISTS { ?object a ?type . ?type sxml:element "xi:include" } }

0 is good!
Copyright 2011 TopQuadrant Inc 48

Example SPARQL Query the sample Burglary Click to editfor Master title style Incident
Find all people involved in
SELECT ?s ?fn1 ?ssn1 ?fbiID1v ?fpID1v ?fpj1v WHERE { ?s rdf:type digest:EntityPerson . ?s digest:personRef ?p1 . ?p1 core:personNameRef ?pnR1 . ?pnR1 core:personFullNameRef ?pfnR1 . ?pfnR1 dtype:value ?fn1 . ?p1 core:personSSNIdentificationRef ?pSSNR1 . ?pSSNR1 core:identificationIDRef ?pSSN1 . ?pSSN1 dtype:value ?ssn1 . ?p1 digest:personAugmentationRef ?p1a . ?p1a jxdm:personFBIIdentificationRef ?fbiID1 . ?fbiID1 core:identificationIDRef ?fbicID1 . ?fbicID1 dtype:value ?fbiID1v . ?p1a jxdm:personStateFingerprintIdentificationRef ?fp1 . ?fp1 core:identificationIDRef ?fpcID1 . ?fpcID1 dtype:value ?fpID1v . ?fp1 core:identificationJurisdictionRef ?fpj1 . ?fpj1 dtype:value ?fpj1v . }

an incident for which we

have full names, SSNs,

FBI IDs, finger prints and

the state of jurisdiction

Copyright 2011 TopQuadrant Inc

49

Using Magic Properties and Property Chains Click to edit Master title style lexs:getFullName to simplify the SPARQL SELECT ?name WHERE {
SELECT ?s ?fn1 ?ssn1 ?fbiID1v ?fpID1v ?fpj1v WHERE { ?s rdf:type digest:EntityPerson . ?s digest:personRef ?p1 . ?p1 lexs:getFullName ?fn1 . ?p1 lexs:getSSN ?ssn1 . ?p1 digest:personAugmentationRef ?p1a . ?p1a lexs:getFBI-ID ?fbiID1v . ?p1a lexs:getFingerprintID ?fpID1v . ?p1a lexs:getFingerprintIDState ?fpj1v . }
?arg1 ( core:personNameRef / core:personFullNameRef / dtype:value ) ?name. }

lexs:getSSN
SELECT ?ssn WHERE { ?arg1 ( core:personSSNIdentificationRef / core:identificationIDRef / dtype:value ) ?ssn. }

lexs:getFBI-ID
SELECT ?id WHERE { ?arg1 ( jxdm:personFBIIdentificationRef / core:identificationIDRef / dtype:value ) ?id . }

lexs:getFingerprintID

Magic Property

SELECT ?id WHERE { ?arg1 (jxdm:personStateFingerprintIdentificationRef / core:identificationIDRef / dtype:value) ?id . }

lexs:getFingerprintStateID

Property Chain
Copyright 2011 TopQuadrant Inc

SELECT ?id WHERE { ?arg1 ( jxdm:personStateFingerprintIdentificationRef / core:identificationJurisdictionRef / dtype:value) ?id . }

50

To demonstrate interesting queries Click to edit Master title style over the LEXS model we needed more data
Only one example file was available Because we cannot use real data, we built a random cloner of the single instance file using fake data
Random values where chosen from enumerated values Random witnesses, victims and suspects were taken from a database of fake people Random dates were generated

The resultant dataset can have any number of incidents

Copyright 2011 TopQuadrant Inc 51

Generating Random Instance Click to edit Master title Data style using the RDF Instance Graph Seed
burglary-incident-warrest-basic-lexs (RDF)

Automatic Cloner Using Deep Random Graph Copier

1 Seed Graph

1000 Graph Clones

Copyright 2011 TopQuadrant Inc

52

Click to to edit Master style Where find faketitle people?

http://www.fakenamegenerator.com/order.php RDF/OWL Instances

Using TopBraid, CSV file of up to 10,000 names was converted to RDF/OWL triples

This was done using SPINMap

Copyright 2011 TopQuadrant Inc

53

SPINMap used to transform the Click towas edit Master title style Fake People to NIEM/LEXS People
RDF/OWL Instances

Copyright 2011 TopQuadrant Inc

54

SPARQLMotion Script for the generation of Click to edit Master title style Random Incidents using Fake People
Initialize script variables to set the count of random incidents and other graph base uris For each random incident graph, this controls the generation of fake instances Clones the seed graph to make each new incident graph For each type of person (witness, victim, etc.), a random fake name is picked from the Fake Names Graph On completion, the new graph is exported.

Copyright 2011 TopQuadrant Inc

55

Generation Incidents using Fake Click of toRandom edit Master title style People and Randomized Values
Incident 1
4 Witnesses
Victim Victim Incident 1 Victim

Incident n

2 Witnesses

Dispatcher

Incident 10

Dispatcher
Operator

Operator Officer Officer

Victim

1 Arrestee

2 Arrestees

Copyright 2011 TopQuadrant Inc

56

Using SPIN classify Person Instances Click to to edit Master title style

Copyright 2011 TopQuadrant Inc

57

data type properties to direct attributes

Witness Class Sub-class Relationships Victim Class Operator Class Officer Class Male Class Person Class

Using SPIN toMaster transform Person Click to edit title style

SPIN Rule on Person Class

Female Class

Dispatcher Class
Arrestee Class

Copyright 2011 TopQuadrant Inc

58

A Query Click over to edit the Master Incidents title Data style (1 of 2)
Find all people who have

been both a witness and an

arrestee across all incidents
Whats interesting about Bartholomeus is that he was the dispatcher and got arrested for incident 10! So whats going on here? Did he conspire with Masato? Masato M. Sai was arrested in incident 4, but he was also a witness, which seems suspicious. Especially considering he was an officer in incident 10 and a dispatcher in incident 1.

Copyright 2011 TopQuadrant Inc

59

A Query Click over to edit the Master Incidents title Data style (2 of 2)

Not surprising to confuse the police as

suspects if you see this going on

Copyright 2011 TopQuadrant Inc

60

Click to edit Data Master title style So why Integrate using RDF/OWL?
Frictionless Data

Ontology-Driven Data Refineries

Copyright 2011 TopQuadrant Inc

61

Click to edit Master style Possible Next title Steps

Enhance XML Schema to OWL transformations to produce more canonical OWL Models (direct properties) Form a community of interest?
Publish NIEM and LEXS OWL Models and SKOS Vocabularies?

Demonstrate data integration for LEXS-extended or none LEXSbased IEPDs using OWL Neutral Models and SKOS vocabularies
DoJ IEPD Clearinghouse lists over 200 custom IEPDs and this is growing

Provide tooling for generating custom IEPDs using RDF/OWL ontologies with composable message components

Copyright 2011 TopQuadrant Inc

62

Concluding Remarks
On balance, in the limited time we had, the presentation attempted to show:
1. automatic generation of OWL Models and Vocabularies from XML Schemas 2. automatic generation of RDF/OWL Graphs from XML-compliant messages 3. OWL as an expressive specification language for information models and vocabularies 4. SPARQL as a powerful way of exploring both data and models and doing transformations
Tunnel_Train By Pro-Zak, Flickr, http://www.flickr.com/photos/vogelium/3525283716/

Two Stones by ~ Martin ~, Flickr, http://www.flickr.com/photos/ martinlang/3287315552/

Copyright 2011 TopQuadrant Inc

63

Click NIEM to edit References Master title style

Main Site
http://www.ise.gov/national-information-exchange-model-niem

Clearing House
http://it.ojp.gov/framesets/iepd-clearinghouse-noClose.htm

DoJ
http://www.it.ojp.gov/default.aspx?area=implementationAssistance&pa ge=1017&standard=520

HSDL
http://www.hsdl.org/?view&did=487388

Other
http://www.ibm.com/developerworks/library/x-NIEM4/

Copyright 2011 TopQuadrant Inc

64

Click to edit Thank Master You title style

Ralph Hodgson
E-mail: rhodgson@topquadrant.com Twitter: @topquadrant, @ralphtq, @oegovnews

Some of our books

Copyright 2011 TopQuadrant Inc

65