Skip to content

Commit b22645f

Browse files
howeyehoweye
authored
Merge pull request #11 from WeBankFinTech/branch-0.6.0
merge Branch 0.6.0 to master
2 parents 03037b3 + 23c81ab commit b22645f

File tree

9 files changed

+89
-13
lines changed

9 files changed

+89
-13
lines changed

‎README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
English | [中文](docs/zh_CN/ch1)
44

55
## Overview
6-
Qualitis is a one-stop data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing.
6+
Qualitis is a data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing.
77

88
Based on Spring Boot, Qualitis submits quality model task to [Linkis](https://github.com/WeBankFinTech/Linkis) platform. It provides functions such as data quality model construction, data quality model execution, data quality verification, reports of data quality generation and so on.
99

‎docs/en_US/ch1/Linkis Access Guide.md

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
# How to get Linkis Token
2+
3+
## Linkis Configuration
4+
### Add Linkis Token
5+
```
6+
cd $LINKIS_HOME/linkis-gateway/conf
7+
vim token.properties
8+
```
9+
10+
Add line as follow:
11+
```
12+
QUALITIS-AUTH=*
13+
```
14+
15+
### Modify Linkis Default Queue of User
16+
1. Login in DataSphere Studio using the user same as qualitis.
17+
18+
2. Enter 'Linkis Console' -> Settings -> wds.linkis.yarnqueue, and then set a queue in yarn.
19+
20+
### Add Lib of MySQL
21+
```
22+
cd $LINKIS_HOME/linkis-ujes-spark-enginemanager/lib
23+
```
24+
Add MySQL Lib in it.
25+
26+
At last, restart Linkis.
27+
28+
## Qualitis Configuration
29+
Type in 'QUALITIS-AUTH' in the blank of Linkis Token:
30+
Here is an example：
31+
![](../../../images/en_US/ch1/ClusterConfigurationDemo.png)

‎docs/en_US/ch1/QuickDeploy.md

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,8 @@ JDK (1.8.0_141)
77
Hadoop (2.7.2)
88
Hive (1.2.1)
99
Zookeeper (3.4.9)
10-
Linkis (0.9.0), Spark engine required.[How to install Linkis?](https://github.com/WeBankFinTech/Linkis)
11-
DataSphereStudio (0.5.0) Optional. If you want to use workflow, it it required. [How to install DataSphereStudio?](https://github.com/WeBankFinTech/DataSphereStudio)
10+
Linkis (0.9.1), Spark engine required.[How to install Linkis?](https://github.com/WeBankFinTech/Linkis)
11+
DataSphereStudio (0.6.0) Optional. If you want to use workflow, it it required. [How to install DataSphereStudio?](https://github.com/WeBankFinTech/DataSphereStudio)
1212

1313
## 2. Download
1414
[Download](https://github.com/WeBankFinTech/Qualitis/releases)
@@ -83,10 +83,7 @@ Cluster type
8383
HiveMetaStore address
8484
HiveServer2 address
8585
Linkis address
86-
Linkis Token
87-
Hive database address
88-
Hive database username
89-
Hive database password
86+
Linkis Token(How to get Linkis Token：[Linkis Access Guide](Linkis Access Guide.md))
9087

9188
Here is an example:
9289
![](../../../images/en_US/ch1/ClusterConfigurationDemo.png)

‎docs/en_US/ch1/UpdateGuide.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# Update Guide
2+
3+
## update from 0.5.0 to 0.6.0
4+
Download code of 0.6.0 version.
5+
6+
Execute the following code below:
7+
```
8+
mysql -u {USERNAME} -p {PASSWORD} -h {IP} --default-character-set=utf8
9+
source conf/database/update/update_0.5.0-0.6.0.sql
10+
```

‎docs/zh_CN/ch1/升级指南.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# 升级指南
2+
3+
## 0.5.0 升级 0.6.0
4+
下载0.6.0版本代码，并解压。
5+
6+
执行以下数据库脚本:
7+
```
8+
mysql -u {USERNAME} -p {PASSWORD} -h {IP} --default-character-set=utf8
9+
source conf/database/update/update_0.5.0-0.6.0.sql
10+
```

‎docs/zh_CN/ch1/快速搭建手册.md

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,8 @@ JDK (1.8.0_141)
77
Hadoop (2.7.2)
88
Hive (1.2.1)
99
Zookeeper (3.4.9)
10-
Linkis（0.9.0), 必装Spark引擎。[如何安装Linkis](https://github.com/WeBankFinTech/Linkis)
11-
DataSphereStudio (0.5.0) 可选. 如果你想使用工作流，必装DataSphereStudio [如何安装DataSphereStudio?](https://github.com/WeBankFinTech/DataSphereStudio)
10+
Linkis（0.9.1), 必装Spark引擎。[如何安装Linkis](https://github.com/WeBankFinTech/Linkis)
11+
DataSphereStudio (0.6.0) 可选. 如果你想使用工作流，必装DataSphereStudio [如何安装DataSphereStudio?](https://github.com/WeBankFinTech/DataSphereStudio)
1212

1313
## 二、安装包下载
1414
[下载](https://github.com/WeBankFinTech/Qualitis/releases)
@@ -83,10 +83,7 @@ sh bin/start.sh
8383
HiveMetaStore地址
8484
HiveServer2地址
8585
Linkis地址
86-
Linkis Token
87-
Hive数据库地址(用于连接HiveMetaStore的MySQL数据库)
88-
Hive数据库用户名(用于连接HiveMetaStore的MySQL数据库)
89-
Hive数据库密码(用于连接HiveMetaStore的MySQL数据库)
86+
Linkis Token(Linkis Token配置方式请查看文档：[接入Linkis文档](接入Linkis文档.md))
9087

9188
可参考以下例子：
9289
![](../../../images/zh_CN/ch1/规则配置样例.png)

‎docs/zh_CN/ch1/接入Linkis文档.md

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
# 接入Linkis文档
2+
3+
## Linkis配置
4+
### 增加Linkis Token
5+
```
6+
cd $LINKIS_HOME/linkis-gateway/conf
7+
vim token.properties
8+
```
9+
10+
增加以下行：
11+
```
12+
QUALITIS-AUTH=*
13+
```
14+
15+
### 修改用户默认提交队列
16+
1. 在DataSphere Studio中登录Qualitis同名的用户名
17+
18+
2. 进入Linkis管理台 -> 设置 -> yarn队列名中，并设置一个可用的yarn队列
19+
20+
### 加入MySQL依赖包
21+
```
22+
cd $LINKIS_HOME/linkis-ujes-spark-enginemanager/lib
23+
```
24+
并加入mysql依赖包
25+
26+
最后，重启Linkis
27+
28+
## Qualitis配置
29+
在Linkis Token中填入'QUALITIS-AUTH'
30+
如下图所示：
31+
![](../../../images/zh_CN/ch1/规则配置样例.png)

‎images/en_US/ch1/ClusterConfigurationDemo.png

-3.47 KB
Loading

‎images/zh_CN/ch1/规则配置样例.png

-3.93 KB
Loading

0 commit comments

Comments
 (0)