Data Warehouses - Introduction

1
Data Warehouses
??????? ?????? ????
OLAP
MDBMS
Star Schema
ODS
ROLAP
Snowflake Schema
Datamart
MPP
???? ?? ??????? ???? ??? ????
2
????? - ??????, ??????
?????? ??????? ?????? ?????? ??????? ?????
??????? ?????? ????, ?????, ????? ?????? ?????
??????? ???? ?????? ?????? ???? ?????? ????
?????? ??????? ???
?? ??????? ?????
?? ????? ???????
?? ??????? ?????
?? ???????? ?????
???? ??? ?????? - ???? ??? ????
3
????? ??? ??????, ????????
4
??????? ???????The Decision Support Value Chain
?????? - ??????
Data - Facts
????
Information
???
Knowledge
??????
Decisions
5
?????? - ??????Data - Facts
?????? - ??????
Data - Facts
????? ?? ?? ????? ?? ?????? ?????? ????????? ??
?????
????
Information
???
Knowledge
??????
Decisions
6
?????? ?????? ?????Information
?????? - ??????
Data - Facts
????
Information
????? ?????? ???? ??????? ????? ??????? ????????
??? ??? ???? ??????
???
Knowledge
??????
Decisions
7
???? ???? ????Knowledge
?????? - ??????
Data - Facts
???? ?? ?????? ???? ??????? ????? 67 ????
?? ????? ??? ??? 40 ????? ????? ?? ???
100,000 ???? ????
????
Information
???
Knowledge
??????
Decisions
8
??? ???? ???????Decisions
?????? - ??????
Data - Facts
????
Information
????? ?????? ??? ?? ????? ????? ??????? ????????
??????
???
Knowledge
??????
Decisions
9
????? ????? ????? ??? ????????An Iterative
Process
Query
Analysis
Reporting
10
?????? ???????????? ???????
11
???? ???? ??????? ????????
Operational Databases
Query Tools
???? ??????? ?? ????? ?????? ???? ?????? ???????
???????? ??????? ????????? ??????? ???????
???????? ????? ??????? ???? ?????? ??? ???????
????? ????? ????? ??????
12
????? ????
Operational Databases
Information Center
Query Tools Decision Support Tools
???? ????? ????? ?? ?????????? ??????
??????? ???? ?????? ???? ????? ???????? ???
???????? ??????? ????? ???? ?????? ???????? ???
????? ?????? ?????
13
??????????? ?????? ?????? ???????
14
???? ????? ?? ????? ???????Driving Forces
???? ??? ??????, ???? ??? ???? ??????? ?????????
?????? ???? ??????, ?? ???? ??????? ????? ??? ???
?????? ????? ??????? ?????? ????????, ????? ?????
???? ?????? ???? ????????? ?????? ?????????
??????? ????????? ???? ?????? ?? ???? ?????? ????
?????? ???? ????? ??????? - ??????, ???????
The business case for a data warehouse is
simple it helps turn data into a competetive
tool
ComputerWorld, 1994
15
??? ???? ???????
A Data Warehouse is a subject-oriented,
integrated, time-variant, nonvolatile collection
of data in support of management needs
Bob Inmon - 1992
?????? ??????? ??????, ?? ???? ?????
??????? ????????? ??? ???????, ??????
??????? ???? ???? ??? ?????? ??????,
???????? ?????? ?? ?? ???? ???????? ?????,
????? ????? ??????
Subject Oriented Integrated Time
Variant Nonvolatile Management needs
16
?????????? ????? ?? ???? ?????
?????? ????????
????? ?????? Meta Data
????? ????? Process Mng.
Managed Queries EIS Multi Dimensional Analaysis
Statistical Packages Data Mining
???? ????? ????? ????? ??????
???? ?????
???? ???? ?????
?????? ????????
????? ??????
Datamarts
17
????? ??????? ????? ?????Data Flows
Highly summarized
???????
Light summarized
Up Flow
In Flow
Out Flow
Current Detail
????? ????? ????? ???????????
???? ?????
Old Detail
Down Flow
????? ???????? ?????
Archived
18
?????? ??? ?????? ???????? ????? ?????
???? ???? ?????? ????? ??????? ???? ??????? ????
??????? ???? ?????? ??????? ???? ?????
??????? ??????? ???? ????? ??? ????? ??? ???????
????? ??????? ????? ??? ????? ?????
?????? ????? ?????, ????? ???????? ???? ??????? ??
???, ???? ?? ???? ???? ? 2 ????? ??? ?????? ??????
???? ???? ???????, ??????, ????? ??? ??????
????? ?????? ????? ??????? ???? ?? ??????
??????? ????, ????? ?????? ???? ?????? ??
???? ??? ????? ?? ?????, ??????? ???????? ????
?????, ???? ??? ???? ?????? ??? ???? ??????? ????
?? ???? ???
19
?????? ??? ????? ?????????? ????
????? ???? ????? ??? ?? ?????? ??? ????? ??????
?????? ???????? ????? ????? ?????? ???? ??????
????? SQL ????? ?????? - ???????, ????? ????????,
?????? ? SMP/MPP ????? - ??????, ????????,
??????????? Data Mining ?????????? Extraction
Transformation ??? ????? ????? ?????? Meta Data
Repository ????? ?????? Groupware Workflow ????
???? ??????? ?????? ?? ??? ???????
20
????? ????????????? / ???????
21
???? ????? ????? ????Data Warehouse vs. Datamart
A Datamart is a subject or departmental oriented
data warehouse. It can include data from a
corporate data warehouse and/or local data
Meta Group
Corporate Data Warehouse
Datamarts
Data Mining
Remote Department
OLAP
22
???? ???? ??????Departmental Data Warehouse
?????? ????????
????? ???? ????????
???????
??????
??? ???
?????? ???
23
???? ???? ??????Departmental Data Warehouse
?????? ????????
????? ???? ????????
???????
??????
??? ???
???? ????? ???? ???? ???????? ?????? ??
?????? ???? ?????? ???? ????????? ???
??????? ???? ?????? ??????????? ?????
?????? ???
24
???? ???? ?????Enterprise Data Warehouse
?????? ????????
???? ???? ?????
?????? ???
25
???? ???? ?????Enterprise Data Warehouse
?????? ????????
???? ???? ?????
???? ?????? ???? ???? ??? ???????
??????? ?????????? ????????? ?????
?????? ???
26
???? ???? ????? ??????Enterprise Data Warehouse
Datamarts
?????? ????????
???? ???? ?????
Datamart
?????? ???
27
???? ???? ????? ??????Enterprise Data Warehouse
Datamarts
?????? ????????
????? ????? ????? ?????? OLAP, Data Mining ?????
??????? ???????? ?? ???? ???
???? ???? ?????
?????? ????????
?????? ???
28
????? ??????Data Mining
29
?? ?? ????? ??????Data Mining Definitions
Data Mining is the application of computer
technology and machine learning algorithms to
discover patterns, anomalies, trends and
knowledge from data.
Silicon Graphics
Data Mining is the application of artificial
intelligence techniques (neural networks, fuzzy
logic, genetic algorithms) to large quantities
of data to discover hidden trends, patterns and
relationships. Knowledge applies to the process
of translating the results of data mining into
actionable business plans.
Meta Group, 1996
30
??????? ?????? ?????? ??????

• Classification
• Clustering
• Association
• Sequential Pattern

• Visualization
• Statistics
• Rule Induction
• Fuzzy Logic
• Neural Nets
• Knowledge Based

31
????? ?????? ?????? ????
????? ??????? ?????? ?????? ?????? ???? ???????
?????? ???????? ????? ??? ??? ????? ????, ????
?????? ????? ???? ??????? ?????? ???????.
?? ?????? ?? ????? ????? ?? ???? ????? ??????,
???????????
Selecting Transforming Mining Interpreting
32
??????? ????????
????? ????? ????? ?? ?????? ????? ????? ??????
????? ?????? ????? ????? ???????? ?? ??????
?????? ????? ?????????
33
??????? ????????????? ????? ??????
34
????? ?????? ???? ??????
??????? ?????? ????? ?????? ?????? ??
??????? ???? ???? ???? ?????? ??????? ???????
????? ??????? ???? ???? ?????? ???????? ???
??????? ????????? ????? ????? ???? ?? ?????? ???
???? ??? ???? ?????? ?????? - ?????, ?????,
??????, ????? ????? ??????? ?????? ?? ?????? ????
????? ?????? ???? ?????? ???? ?????? ?????? ????
?????? ???? ??????
35
??????? ??????? ???? ??????
???????? ???????? ????? ???? ?????? ?????? ?????
?????? ??????????? ?? ?????? ??????? ????????
????? ??????? ?????? ???????? ?????? ????? ??
???????? ??????? ????? ????? ???? ????? ??????
36
????? ????? ???? ??????
??????????
???? ???
????? ??????
?????? ?????
??? ???????
?????? ?????
???? ??????
???? ?????
???? ??????????
???? ???
???? ?????
37
?????
38
?????? ???????From Data Jailhouse to Data
Warehouse
Get Business
Do Business
Keep Score
Data Warehouse
Operational Systems
???? ???? ????? ???? ?? ????? ????? ????? ?????
??????? ?? ??????? ??????? ??????? ?????? ????
????? ??????????? ??? ???????? ????? ?????
??????? ??????? ????? ??????? ???? ?????? ??
?????? ???? ???? ????????
39
???????? ???????? ??????? ??????????? ?????
?? ????????
?? ???????? ???????
??????? ????? ?????? ??? ???
??????? ????? ?????? ??? ???
?????? ??? ????????
Internet Intranet
????? ????
OLAP QME DSS EIS Data Mining
?? ?????? ?????
DSS EIS
40
????? ???????
???? ???? ?????? ???? ??????? ????? ???????
?????? ?????? ???? ?????? ??????? ????? ??????
????? ????? ?????????? ???? ????? ?????? ??????
????????
41
????