CockroachDB

CockroachDB是一個分散式的資料庫軟體，目標是與PostgreSQL相容但可以提供橫向擴充的能力。

安裝

CockroachDB的設計是單一執行檔，沒有複雜的安裝包，所以下載複製到目錄裡即可：

cd /tmp
wget -qO- https://binaries.cockroachdb.com/cockroach-v2.1.3.linux-amd64.tgz | tar xvz
cp -i cockroach-v2.1.3.linux-amd64/cockroach /usr/local/bin

設定

設定分成兩塊，一塊是初始第一台機器：

cockroach start --background --insecure --listen-addr=0.0.0.0 --advertise-addr=$(ifconfig eth0 | grep inet | awk '{print $2}')

另外一塊是後續的機器，多了--join要設定：

cockroach start --background --insecure --listen-addr=0.0.0.0 --join=192.168.x.x --advertise-addr=$(ifconfig eth0 | grep inet | awk '{print $2}')

可以用以下指令確認機器都有連上cluster：

cockroach node ls --insecure

然後用PostgreSQL的client連上測試：

psql -h 192.168.x.x -p 26257 -U root

另外可能要修改replica的數量（預設是5）：

ALTER RANGE default CONFIGURE ZONE USING num_replicas = 3;

測試

使用一台c5.2xlarge與五台r5.large架設Kubernetes後在裡面建立六個Pod測試。

Kubernetes

使用Kubernetes時的設定檔如下：

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: poc-c5
spec:
  replicas: 1
  serviceName: cockroachdb-c5
  selector:
    matchLabels:
      app: cockroachdb-c5
  template:
    metadata:
      labels:
        app: cockroachdb-c5
    spec:
      containers:
      - name: cockroachdb-c5
        image: ubuntu:18.04
        command: ["/bin/sh", "-c"]
        args:
          - export DEBIAN_FRONTEND=noninteractive;
            sed -i 's/archive.ubuntu.com/us.archive.ubuntu.com/' /etc/apt/sources.list;
            apt update;
            apt install -y ant default-jdk git iproute2 iputils-ping locales mtr-tiny net-tools openjdk-8-jdk postgresql-client sysbench tzdata vim-nox wget;
            update-alternatives --set java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java;
            locale-gen en_US.UTF-8;
            cd /root;
            git clone https://github.com/oltpbenchmark/oltpbench.git;
            cd oltpbench;
            sed -i -e 's/^ALTER TABLE/-- ALTER TABLE/' src/com/oltpbenchmark/benchmarks/tpcc/ddls/tpcc-postgres-ddl.sql;
            ant clean;
            ant;
            cp config/tpcc_config_postgres.xml config/tpcc.xml;
            sed -i -e 's/localhost:5432/cockroachdb-port.default.svc.cluster.local:26257/' config/tpcc.xml;
            sed -i -e 's/<username>tpcc/<username>root/' config/tpcc.xml;
            sed -i -e 's/<password>tpcc/<password>' config/tpcc.xml;
            sed -i -e 's/TRANSACTION_READ_COMMITTED/TRANSACTION_SERIALIZABLE/' config/tpcc.xml;
            sleep 3153600000
        env:
        - name: LC_ALL
          value: en_US.UTF-8
      nodeSelector:
        instancetype: c5
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: poc-r5
spec:
  replicas: 5
  serviceName: cockroachdb-r5
  selector:
    matchLabels:
      app: cockroachdb-r5
  template:
    metadata:
      labels:
        app: cockroachdb-r5
    spec:
      containers:
      - name: cockroachdb-r5
        image: ubuntu:18.04
        command: ["/bin/sh", "-c"]
        args:
          - export DEBIAN_FRONTEND=noninteractive;
            sed -i 's/archive.ubuntu.com/us.archive.ubuntu.com/' /etc/apt/sources.list;
            apt update;
            apt install -y iproute2 iputils-ping locales mtr-tiny net-tools tzdata vim-nox wget;
            locale-gen en_US.UTF-8;
            cd /tmp;
            wget -qO- https://binaries.cockroachdb.com/cockroach-v2.1.3.linux-amd64.tgz | tar xvz;
            cp -i cockroach-v2.1.3.linux-amd64/cockroach /usr/local/bin;
            sleep 3153600000
        env:
        - name: LC_ALL
          value: en_US.UTF-8
      nodeSelector:
        instancetype: r5
---
apiVersion: v1
kind: Service
metadata:
  name: cockroachdb-port
spec:
  selector:
    app: cockroachdb-r5
  ports:
    - protocol: TCP
      port: 26257
      targetPort: 26257

後續的測試都需要先連入poc-c5-0的terminal：

kubectl exec -it poc-c5-0 /bin/bash

oltpbenchmark

這邊是拿oltpbenchmark測試。

指令

CREATE DATABASE tpcc;

cd /root/oltpbench
./oltpbenchmark -b tpcc -c config/tpcc.xml --create=true --load=true
./oltpbenchmark -b tpcc -c config/tpcc.xml --execute=true

Sysbench

這邊是拿sysbench測試。

指令

CREATE DATABASE sbtest;

sysbench --db-driver=pgsql --pgsql-host=cockroachdb-port.default.svc.cluster.local --pgsql-port=26257 --pgsql-user=root --pgsql-password= --time=0 --events=10000000 --report-interval=1 --threads=128 /usr/share/sysbench/oltp_insert.lua prepare
sysbench --db-driver=pgsql --pgsql-host=cockroachdb-port.default.svc.cluster.local --pgsql-port=26257 --pgsql-user=root --pgsql-password= --time=0 --events=10000000 --report-interval=1 --threads=128 /usr/share/sysbench/oltp_insert.lua run

外部連結

• 官方網站