Skip to content

Commit 080ac1e

Browse files
authored
Merge pull request #2635 from dolthub/gitbook-dev
publish
2 parents 779c4bd + 4845224 commit 080ac1e

File tree

10 files changed

+66
-65
lines changed

10 files changed

+66
-65
lines changed
127 KB
Loading

packages/dolt/content/introduction/use-cases/manual-data-curation.md

Lines changed: 16 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -4,16 +4,16 @@ title: Manual Data Curation
44

55
# Problem
66

7-
* Are you using spreadsheets to curate production data?
8-
* Is the process of merging and reviewing everyone’s changes getting out of hand?
9-
* Are bad data changes causing production issues?
10-
* Would human review of cell-level data changes help?
7+
- Are you using spreadsheets to curate production data?
8+
- Is the process of merging and reviewing everyone’s changes getting out of hand?
9+
- Are bad data changes causing production issues?
10+
- Would human review of cell-level data changes help?
1111

1212
# Dolt solves this by…
1313

1414
Dolt allows you to treat your spreadsheet like code. DoltHub and DoltLab implement a [Pull Request workflow](../../concepts/dolthub/prs.md) on tables, the standard for reviewing code changes. Extend that model to your data changes. Make changes on [branches](../../concepts/dolt/git/branch.md) and then have the changes human reviewed. Data diffs are easily consumed by a human reviewer. Add continuous integration tests to data changes. Have dozens or hundreds of changes in flight at one time.
1515

16-
DoltHub and DoltLab support [SQL](../../concepts/dolt/sql/README.md), File Upload (CSV), and a spreadsheet editor for data modification. These interfaces are simple enough that non-technical users can make and review data changes.
16+
DoltHub and DoltLab support [SQL](../../concepts/dolt/sql/README.md), File Upload (CSV), and a spreadsheet editor for data modification. These interfaces are simple enough that non-technical users can make and review data changes.
1717

1818
Dolt is a MySQL compatible database so exporting the manually created data to production can be as simple as cloning a copy and starting a server for your developers to connect to.
1919

@@ -25,22 +25,20 @@ Dolt replaces Excel or Google Sheets for manual data curation. Versioning featur
2525

2626
# Companies Doing This
2727

28-
* [Annalise](https://usa.annalise.ai/)
29-
* [Briya](https://briya.com/)
30-
* [Aktify](https://aktify.com/)
31-
* [Blonk Sustainability](https://blonksustainability.nl/)
32-
* [IMTF](https://imtf.com/)
33-
* [Lumicks](https://lumicks.com/)
34-
* [Merkle Science](https://www.merklescience.com/)
35-
* [Idearoom](https://www.idearoom.com/)
28+
- [Annalise](https://annalise.ai/)
29+
- [Briya](https://briya.com/)
30+
- [Aktify](https://aktify.com/)
31+
- [Blonk Sustainability](https://blonksustainability.nl/)
32+
- [IMTF](https://imtf.com/)
33+
- [Lumicks](https://lumicks.com/)
34+
- [Merkle Science](https://www.merklescience.com/)
35+
- [Idearoom](https://www.idearoom.com/)
3636

3737
# Case Studies
3838

39-
* [Aktify](https://www.dolthub.com/blog/2021-10-01-dolt-aktify/)
39+
- [Aktify](https://www.dolthub.com/blog/2021-10-01-dolt-aktify/)
4040

4141
# Other Related Articles
4242

43-
* [So you want Spreadsheet Version Control?](https://www.dolthub.com/blog/2022-07-15-so-you-want-spreadsheet-version-control/)
44-
* [Edit like a Spreadsheet V1](https://www.dolthub.com/blog/2021-10-04-edit-like-spreadsheet-v1/)
45-
46-
43+
- [So you want Spreadsheet Version Control?](https://www.dolthub.com/blog/2022-07-15-so-you-want-spreadsheet-version-control/)
44+
- [Edit like a Spreadsheet V1](https://www.dolthub.com/blog/2021-10-04-edit-like-spreadsheet-v1/)

packages/dolt/content/other/faq.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -19,11 +19,11 @@ not taken in the standard command line lexicon. So,
1919

2020
## Dolt is MySQL-compatible. I use Postgres?
2121

22-
We released a Postgres version of Dolt called [DoltgreSQL](https://github.com/dolthub/doltgresql).
22+
We released a Postgres version of Dolt called [DoltgreSQL](https://github.com/dolthub/doltgresql).
2323

24-
However, Dolt is a production-grade version controlled database today.
25-
[Dolt is 1.0](https://www.dolthub.com/blog/2023-05-05-dolt-1-dot-0/).
26-
If you are ok with using a MySQL-client, we recommend using Dolt for
24+
However, Dolt is a production-grade version controlled database today.
25+
[Dolt is 1.0](https://www.dolthub.com/blog/2023-05-05-dolt-1-dot-0/).
26+
If you are ok with using a MySQL-client, we recommend using Dolt for
2727
all use cases. Doltgres is experimental.
2828

2929
## What does `@@autocommit` do?
@@ -84,14 +84,14 @@ for many popular ORMs and tools.
8484

8585
If you try it and it doesn't work, [let
8686
us know with an issue](https://github.com/dolthub/dolt/issues) or in
87-
[our Discord](https://discord.gg/s8uVgc3) and we'll [fix it in 24 hours](https://www.dolthub.com/blog/2024-05-15-24-hour-bug-fixes/).
87+
[our Discord](https://discord.gg/s8uVgc3) and we'll [fix it in 24 hours](https://www.dolthub.com/blog/2024-05-15-24-hour-bug-fixes/).
8888
Our goal is to be a 100% drop-in replacement for MySQL.
8989

9090
## Why does Dolt use so much disk space?
9191

9292
Dolt generates a lot of garbage during some writes, especially during initial import. It's not
9393
unusual to get a local storage size of 20x the actual data size after an import. Running `dolt gc`
94-
will remove the garbage and reclaim local storage. See the [docs on `dolt gc`](../reference/cli/cli.md#dolt-gc)
94+
will remove the garbage and reclaim local storage. See the [docs on `dolt gc`](../reference/cli/cli.md#dolt-gc)
9595
and the [`dolt_gc` stored procedure](../reference/sql/version-control/dolt-sql-procedures.md#dolt_gc) for details.
9696

9797
If you are concerned about the growth of a Dolt database at steady state while running the SQL server, there is [an experimental feature](../reference/sql/server/garbage-collection.md#automated-gc) to automatically run `dolt_gc()` as the database grows.
@@ -131,13 +131,13 @@ call dolt_stats_purge();
131131

132132
Version incompatibilities should not hinder the purge command, but if
133133
manual intervention is desirable a specific database's
134-
stats cache can be removed from the filestystem:
134+
stats cache can be removed from the filesystem:
135135

136136
```bash
137137
rm -rf .dolt/stats
138138
```
139139

140140
Statistics can be recollected at any time to improve join and indexing
141141
execution performance. See
142-
[the stats docs](../reference/sql/sql-support/miscellaneous#stats-controller-functions)
142+
[the stats docs](../reference/sql/sql-support/miscellaneous.md#stats-controller-functions)
143143
for more details.

packages/dolt/content/products/hosted/sso.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ layers of security.
2020

2121
This is what a SAML SSO workflow looks like on Hosted Dolt:
2222

23-
![SAML workflow](../../.gitbook/assets/hosted-sso-saml-diagram.png)
23+
![](../../.gitbook/assets/hosted-sso-saml-diagram.png)
2424

2525
## How to set up SSO for your Hosted organization
2626

@@ -34,7 +34,7 @@ organization](https://hosted.doltdb.com/organizations). In order to set up SSO,
3434
required that your organization has at least one bootstrap admin user at all times that
3535
was not created through the SAML workflow.
3636

37-
![Create organization](../../.gitbook/assets/hosted-create-org.png)
37+
![](../../.gitbook/assets/hosted-create-org.png)
3838

3939
### 2. Set up your third-party IdP
4040

@@ -45,26 +45,26 @@ First, you must create an [Okta Developer Edition
4545
Organization](https://developer.okta.com/signup/). Then, navigate to Applications >
4646
Applications and create a new app integration.
4747

48-
![Okta new app integration](../../.gitbook/assets/okta-new-app-integration.png)
48+
![](../../.gitbook/assets/okta-new-app-integration.png)
4949

5050
Give your app a name and (optional) logo.
5151

52-
![Okta create SAML integration general settings](../../.gitbook/assets/okta-create-saml-integration-general.png)
52+
![](../../.gitbook/assets/okta-create-saml-integration-general.png)
5353

5454
Fill out the SAML settings. You can find this information in the SSO tab of your
5555
organization on Hosted.
5656

57-
![Okta create SAML integration configure SAML](../../.gitbook/assets/okta-create-saml-integration-configure.png)
57+
![](../../.gitbook/assets/okta-create-saml-integration-configure.png)
5858

5959
If you'd like to add a signature certificate to verify the digital signatures, you can
6060
download the certificate from your Hosted organization's SSO page and upload it in
6161
Advanced Settings.
6262

63-
![Okta create SAML integration advanced settings](../../.gitbook/assets/okta-create-saml-integration-advanced-settings.png)
63+
![](../../.gitbook/assets/okta-create-saml-integration-advanced-settings.png)
6464

6565
Once your SAML integration is created it should look something like this:
6666

67-
![Okta SAML integration](../../.gitbook/assets/okta-saml-integration.png)
67+
![](../../.gitbook/assets/okta-saml-integration.png)
6868

6969
Download the metadata details from the provided Metadata URL. You'll need this when you
7070
add this identity provider to your Hosted organization.
@@ -76,33 +76,33 @@ curl -OL https://dev-99612740.okta.com/app/exkb7ksuh3Jn9h90I5d7/sso/saml/metadat
7676
Then in the Assignments tab, choose some People or Groups to assign to your integration.
7777
These people or groups will have single sign on into your Hosted organization.
7878

79-
![Okta assign people](../../.gitbook/assets/okta-saml-assign-people.png)
79+
![](../../.gitbook/assets/okta-saml-assign-people.png)
8080

8181
### 3. Set up Hosted with the metadata from your IdP
8282

8383
Now back to the Hosted website. In the SSO tab of your organization, add the metadata
8484
descriptor you downloaded from your Okta integration and click `Configure`.
8585

86-
![Create SAML provider form](../../.gitbook/assets/hosted-configure-saml-sso.png)
86+
![](../../.gitbook/assets/hosted-configure-saml-sso.png)
8787

8888
You can now share your organization's SSO login url (in this case
8989
https://hosted.doltdb.com/organizations/mycompany/sso) with the people you added to your
9090
Okta integration. They'll also have this link when they log in to their Okta account.
9191

92-
![Okta My Apps](../../.gitbook/assets/okta-my-apps.png)
92+
![](../../.gitbook/assets/okta-my-apps.png)
9393

9494
### 4. Signing in to your organization's login URL
9595

9696
When people from your Okta integration navigate to your organization's Login URL, they'll
9797
be redirected to the Okta SSO URL and prompted to log in (if they aren't already).
9898

99-
![Okta SSO login](../../.gitbook/assets/okta-sso-url.png)
99+
![](../../.gitbook/assets/okta-sso-url.png)
100100

101101
After successfully entering their Okta credentials, the Hosted website will check if a
102102
user exists that matches the Name ID from the SAML response from Okta. If a Hosted user
103103
does not already exist, they will be prompted for an email and username.
104104

105-
![Create SAML account](../../.gitbook/assets/hosted-create-saml-account.png)
105+
![](../../.gitbook/assets/hosted-create-saml-account.png)
106106

107107
The user will receive an email to verify their email address and automatically be added as
108108
a member to your organization. In the future when they log in they will be immediately

packages/dolt/content/reference/sql/supported-clients/clients.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ Once a server is running, any MySQL client should be able to connect to Dolt SQL
1212
$ mysql -u root
1313
Welcome to the MySQL monitor. Commands end with ; or \g.
1414
Your MySQL connection id is 2
15-
Server version: 5.7.9-Vitess
15+
Server version: 5.7.9-Vitess
1616
1717
Copyright (c) 2000, 2022, Oracle and/or its affiliates.
1818
@@ -71,7 +71,7 @@ We support the standard `mysql` Node library.
7171

7272
We support the Java client distributed on the MySQL website called `mysql-connector-java`. For our test we use the architecture independent build.
7373

74-
- [Official Client Documentation](https://dev.mysql.com/doc/connector-j/8.0/en/)
74+
- [Official Client Documentation](https://dev.mysql.com/doc/connector-j/en/)
7575
- [Java mysql-connector test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/java/MySQLConnectorTest.java)
7676

7777
## C
@@ -93,10 +93,12 @@ We support `mysql-connector-cpp`. Getting it to work correctly required we check
9393
We support [MySQL.Data.MySqlClient](https://dev.mysql.com/doc/connector-net/en/) distributed by MySQL and the asynchronous [MySqlConnector](https://mysqlconnector.net/). On OSX and Ubuntu we tested the client using [.Net core SDK](https://dotnet.microsoft.com/download/dotnet-core/3.1).
9494

9595
### MySQL.Data.MySqlClient
96+
9697
- [Official Client Documentation](https://dev.mysql.com/doc/connector-net/en/)
9798
- [MySql.Data test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/dotnet/MySqlClient/Program.cs)
9899

99100
### MySQLConnector
101+
100102
- [Official Client Documentation](https://mysqlconnector.net/)
101103
- [MySqlConnector test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/dotnet/MySqlConnector/Program.cs)
102104

@@ -108,6 +110,7 @@ We support the [DBD::mysql](https://metacpan.org/pod/DBD::mysql) package that im
108110
- [DBD:mysql test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/perl/dbd-mysql-test.pl)
109111

110112
## PHP
113+
111114
We support the built in [mysqli](https://www.php.net/manual/en/book.mysqli.php) extension and [PDO](https://www.php.net/manual/en/book.pdo.php) API for connecting to MySQL.
112115

113116
- [Official mysqli Client Documentation](https://www.php.net/manual/en/book.mysqli.php)
@@ -127,10 +130,12 @@ We support the [go-sql-driver/mysql](https://github.com/go-sql-driver/mysql) pac
127130
We support the native [ruby/mysql](http://www.tmtm.org/en/ruby/mysql/) library and the native [mysql2](https://github.com/brianmario/mysql2) library. The [mysql/ruby](http://www.tmtm.org/en/mysql/ruby/) package uses the MySQL C API and [has not been ported to MySQL client version 8](https://github.com/luislavena/mysql-gem/issues/35). Thus, we do not support `mysql/ruby`.
128131

129132
### mysql2
133+
130134
- [Official Client Documentation](https://www.rubydoc.info/gems/mysql2)
131135
- [mysql2 test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/ruby/mysql2-test.rb)
132136

133137
### ruby/mysql
138+
134139
- [Official Client Documentation](http://www.tmtm.org/en/ruby/mysql/)
135140
- [ruby/mysql test code](https://github.com/dolthub/dolt/blob/main/integration-tests/mysql-client-tests/ruby/ruby-mysql-test.rb)
136141

packages/dolt/content/reference/sql/version-control/querying-history.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ ORDER BY state, to_commit_date;
107107
```
108108

109109
For more information, see the [system table
110-
docs](dolt-system-tables.md).
110+
docs](./dolt-system-tables.md).
111111

112112
## Querying historical view data
113113

packages/doltgres/content/concepts/rdbms/backups.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ Using a [remote](../git/remotes.md) for backup allows you to back up all committ
3939
a remote using the [`select dolt_remote()`
4040
function](../../reference/sql/version-control/dolt-sql-functions.md#dolt_remote). Then you push a
4141
branch to a remote using the [`dolt_push()`
42-
function](../../reference/sql/version-control/dolt-sql-function.md#dolt_push).
42+
function](../../reference/sql/version-control/dolt-sql-functions.md#dolt_push).
4343

4444
## Not yet supported: non-remote backups
4545

packages/doltgres/content/reference/sql/version-control/README.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,5 +27,3 @@ system variables, functions, and stored procedures.
2727
- [System variables](./dolt-sysvars.md) documents all the
2828
Doltgres-provided system variables that expose and control various
2929
aspects of Doltgres's behavior.
30-
- [Saved Queries](./saved-queries.md) documents a Doltgres feature to save
31-
queries for later execution.

packages/doltgres/content/reference/sql/version-control/dolt-sql-functions.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ SELECT DOLT_ADD('.');
6969
```
7070

7171
Version control features that only inspect the state of the database are modeled as [system
72-
tables](./dolt_system_tables.md) or [table functions](#table-functions) instead.
72+
tables](./dolt-system-tables.md) or [table functions](#table-functions) instead.
7373

7474
The functions in this section are also available as stored procedures. Whether you access them as
7575
functions or as procedures is up to you. The main difference is that in Postgres, stored procedures

packages/doltlab/content/guides/installation/README.md

Lines changed: 20 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -8,42 +8,42 @@ You must have a host(s) running a supported operating system, hardware that meet
88

99
# Supported operating systems
1010

11-
- [Linux](./installation/linux.md)
11+
- [Linux](./linux.md)
1212

1313
# Minimum recommended hardware
1414

1515
DoltLab requires the following minimum system resources:
1616

17-
* 4 CPU
18-
* 16 GB of memory
19-
* 300 GB of disk (DoltLab's container images alone require about 4 GBs of disk).
17+
- 4 CPU
18+
- 16 GB of memory
19+
- 300 GB of disk (DoltLab's container images alone require about 4 GBs of disk).
2020

2121
# Networking requirements
2222

2323
DoltLab requires the following networking configuration:
2424

25-
* The IP address or domain name of the host must be discoverable by the Dolt CLI and web browser.
26-
* Hosts must allow egress `TCP` connections.
27-
* The following ports _must_ allow `TCP` connections:
28-
* `22`, for `ssh` connections.
29-
* `80`, for ingress `HTTP` connections.
30-
* `443` for ingress `HTTPS` connections, if DoltLab will use TLS.
31-
* `100`, for ingress connections to DoltLab's [remote data file server](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-remoteapi-server). This is only required for DoltLab <= `v2.3.7`.
32-
* `50051`, for ingress connections to DoltLab's [remote API](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-remoteapi-server).
33-
* `4321`, for ingress connections to DoltLab's [file upload service API](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-file-service-api-server).
25+
- The IP address or domain name of the host must be discoverable by the Dolt CLI and web browser.
26+
- Hosts must allow egress `TCP` connections.
27+
- The following ports _must_ allow `TCP` connections:
28+
- `22`, for `ssh` connections.
29+
- `80`, for ingress `HTTP` connections.
30+
- `443` for ingress `HTTPS` connections, if DoltLab will use TLS.
31+
- `100`, for ingress connections to DoltLab's [remote data file server](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-remoteapi-server). This is only required for DoltLab <= `v2.3.7`.
32+
- `50051`, for ingress connections to DoltLab's [remote API](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-remoteapi-server).
33+
- `4321`, for ingress connections to DoltLab's [file upload service API](https://www.dolthub.com/blog/2022-02-25-doltlab-101-services-and-roadmap/#doltlab-file-service-api-server).
3434

3535
# Dependencies
3636

3737
DoltLab requires the following dependencies:
3838

39-
> [curl](https://www.tecmint.com/install-curl-in-linux/)<br/>
40-
> [unzip](https://www.tecmint.com/install-zip-and-unzip-in-linux/)<br/>
41-
> [docker](https://docs.docker.com/engine/install/)<br/>
42-
> [docker-compose](https://docs.docker.com/compose/install/)<br/>
43-
> [amazon-ecr-credential-helper](https://github.com/awslabs/amazon-ecr-credential-helper)<br/>
44-
> Access to an [SMTP server](https://aws.amazon.com/what-is/smtp/), like [smtp.gmail.com](https://support.google.com/a/answer/176600?hl=en).
39+
- [curl](https://www.tecmint.com/install-curl-in-linux/)
40+
- [unzip](https://www.tecmint.com/install-zip-and-unzip-in-linux/)
41+
- [docker](https://docs.docker.com/engine/install/)
42+
- [docker-compose](https://docs.docker.com/compose/install/)
43+
- [amazon-ecr-credential-helper](https://github.com/awslabs/amazon-ecr-credential-helper)
44+
- Access to an [SMTP server](https://aws.amazon.com/what-is/smtp/), like [smtp.gmail.com](https://support.google.com/a/answer/176600?hl=en).
4545

46-
To streamline dependency installation, with DoltLab >= `v2.1.2` you can run the [installer](../reference/installer.md) with one of the following flags to generate a dependency installation script:
46+
To streamline dependency installation, with DoltLab >= `v2.1.2` you can run the [installer](../../reference/installer.md) with one of the following flags to generate a dependency installation script:
4747

4848
```bash
4949
# generate a script to install DoltLab dependencies on Ubuntu

0 commit comments

Comments
 (0)