summaryrefslogtreecommitdiff
path: root/db
Commit message (Collapse)AuthorAgeFilesLines
* Allow public forks to be deduplicatedZeger-Jan van de Weg2018-12-072-0/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When a project is forked, the new repository used to be a deep copy of everything stored on disk by leveraging `git clone`. This works well, and makes isolation between repository easy. However, the clone is at the start 100% the same as the origin repository. And in the case of the objects in the object directory, this is almost always going to be a lot of duplication. Object Pools are a way to create a third repository that essentially only exists for its 'objects' subdirectory. This third repository's object directory will be set as alternate location for objects. This means that in the case an object is missing in the local repository, git will look in another location. This other location is the object pool repository. When Git performs garbage collection, it's smart enough to check the alternate location. When objects are duplicated, it will allow git to throw one copy away. This copy is on the local repository, where to pool remains as is. These pools have an origin location, which for now will always be a repository that itself is not a fork. When the root of a fork network is forked by a user, the fork still clones the full repository. Async, the pool repository will be created. Either one of these processes can be done earlier than the other. To handle this race condition, the Join ObjectPool operation is idempotent. Given its idempotent, we can schedule it twice, with the same effect. To accommodate the holding of state two migrations have been added. 1. Added a state column to the pool_repositories column. This column is managed by the state machine, allowing for hooks on transitions. 2. pool_repositories now has a source_project_id. This column in convenient to have for multiple reasons: it has a unique index allowing the database to handle race conditions when creating a new record. Also, it's nice to know who the host is. As that's a short link to the fork networks root. Object pools are only available for public project, which use hashed storage and when forking from the root of the fork network. (That is, the project being forked from itself isn't a fork) In this commit message I use both ObjectPool and Pool repositories, which are alike, but different from each other. ObjectPool refers to whatever is on the disk stored and managed by Gitaly. PoolRepository is the record in the database.
* Merge branch 'fix/gb/encrypt-ci-build-token' into 'master'Kamil Trzciński2018-12-073-0/+30
|\ | | | | | | | | | | | | Add CI/CD build encrypted tokens (after revert) Closes #52342 See merge request gitlab-org/gitlab-ce!23649
| * Encrypt CI/CD builds tokensKamil Trzciński2018-12-073-0/+30
| | | | | | | | | | | | | | | | Brings back 1e8f1de0 reverted in !23644 Closes #52342 See merge request gitlab-org/gitlab-ce!23436
* | Merge branch 'fix-broken-seeder-11.6' into 'master'Stan Hu2018-12-072-8/+18
|\ \ | |/ |/| | | | | | | | | Fix broken seeder 11.6 Closes #54949 See merge request gitlab-org/gitlab-ce!23608
| * Simplify the changeShinya Maeda2018-12-071-6/+5
| |
| * Fix broken seeder 11.6Shinya Maeda2018-12-062-4/+15
| |
* | Revert "Merge branch 'fix/gb/encrypt-ci-build-token' into 'master'"Robert Speicher2018-12-063-30/+0
| | | | | | | | | | This reverts commit 1e8f1de034aa9b6a60b640b2b091f60c4d3ba365, reversing changes made to 62d971129da99936a3cdc04f3740d26f16a0c7a6.
* | Merge branch '19376-post-bfg-cleanup' into 'master'Douglas Barbosa Alexandre2018-12-062-1/+11
|\ \ | | | | | | | | | | | | | | | | | | Allow internal references to be removed Closes #19376 See merge request gitlab-org/gitlab-ce!23189
| * | Use BFG object maps to clean projectsNick Thomas2018-12-062-1/+11
| | |
* | | Merge branch '54610-allow-review-jobs-to-fail' into 'master'Douglas Barbosa Alexandre2018-12-062-0/+2
|\ \ \ | |/ / |/| | | | | | | | | | | | | | Retry the review-{deploy,qa} jobs twice, and allow them to fail Closes #54610 and #54717 See merge request gitlab-org/gitlab-ce!23510
| * | Ensure the default ApplicationSetting record is created firstRémy Coutable2018-12-062-0/+2
| |/ | | | | | | Signed-off-by: Rémy Coutable <remy@rymai.me>
* | Merge branch 'zj-fixture-fork' into 'master'Douwe Maan2018-12-061-0/+16
|\ \ | | | | | | | | | | | | Fixture for forks See merge request gitlab-org/gitlab-ce!23613
| * | Fixture for forksZeger-Jan van de Weg2018-12-061-0/+16
| | | | | | | | | | | | | | | Forks influence the working of GitLab, and now getting in a fork is a situation that's harder than it needs to be.
* | | Merge branch '53994-add-missing-ci_builds-partial-indices' into 'master'Andreas Brandl2018-12-063-0/+67
|\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Resolve "Database schema diff 4 - (source) Missing partial index for ci_builds in the source (index_ci_builds_project_id_and_status_for_live_jobs_partial)" Closes #53994 See merge request gitlab-org/gitlab-ce!23268
| * | | Remove redundant ci_builds partial index on GitLab.comLin Jen-Shin2018-12-031-0/+33
| | | |
| * | | Add partial index for ci_builds on project_id and statusLin Jen-Shin2018-12-032-0/+34
| |/ /
* | | Merge branch 'partial-index-for-merge_request_id' into 'master'Andreas Brandl2018-12-062-3/+3
|\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Use partial index on `merge_request_id` Closes #54913 See merge request gitlab-org/gitlab-ce!23609
| * | | Change to partial indexpartial-index-for-merge_request_idShinya Maeda2018-12-062-3/+3
| | |/ | |/|
* | | Merge branch 'fix/gb/encrypt-ci-build-token' into 'master'Kamil Trzciński2018-12-063-1/+31
|\ \ \ | |/ / |/| | | | | | | | | | | | | | Encrypt CI/CD builds tokens Closes #52342 See merge request gitlab-org/gitlab-ce!23436
| * | Use partial NOT NULL index for token_encrypted fieldGrzegorz Bizon2018-12-052-2/+2
| | |
| * | Add encrypted token field to ci_builds tableGrzegorz Bizon2018-12-053-1/+31
| | |
* | | Rename project's pipelines relationFrancisco Javier López2018-12-051-1/+1
| | |
* | | Merge request pipelinesShinya Maeda2018-12-053-0/+38
|/ /
* | Revert "Revert "Remove runner token indices from db schema as well""Yorick Peterse2018-12-041-3/+0
| | | | | | This reverts commit d7291c6499563fd9b06b7b3e282a5d09288f5684
* | Revert "Remove runner token indices from db schema as well"🤖 GitLab Bot 🤖2018-12-041-0/+3
| | | | | | This reverts commit c3d0f1294c237853b9d5a3b13f3ea7a2abb84eb4
* | Remove runner token indices from db schema as wellGrzegorz Bizon2018-12-041-3/+0
| |
* | Merge commit '83f0798e7dc588f0e4cb6816daadeef7dbfc8b81' into ↵Grzegorz Bizon2018-12-043-0/+29
|\ \ | |/ | | | | | | | | fix/gb/encrypt-runners-tokens * commit '83f0798e7dc588f0e4cb6816daadeef7dbfc8b81': (101 commits)
| * Move drop_site_statistics to be a post deployment migrationGabriel Mazetto2018-11-291-0/+0
| | | | | | | | | | As post deployment migration we don't need to make it a migration that requires downtime
| * Store hashed storage paths in the databaseToon Claes2018-11-292-0/+29
| |
* | Do not add indices for encrypted tokens in this iterationGrzegorz Bizon2018-12-031-21/+0
| |
* | Merge commit '6852680584a1b22788f451457a6042eabf862a73' into ↵Grzegorz Bizon2018-11-295-9/+79
|\ \ | |/ | | | | | | | | fix/gb/encrypt-runners-tokens * commit '6852680584a1b22788f451457a6042eabf862a73': (57 commits)
| * Merge branch 'security-fix-uri-xss-applications' into 'master'Cindy Pallares2018-11-281-0/+32
| | | | | | | | | | [master] Resolve "Reflected XSS in OAuth Authorize window due to redirect_uri allowing arbitrary protocols" See merge request gitlab/gitlabhq!2572
| * Merge branch 'security-stored-xss-for-environments' into 'master'Cindy Pallares2018-11-281-0/+18
| | | | | | | | | | | | | | [master] Stored XSS for Environments Closes #2727 See merge request gitlab/gitlabhq!2594
| * Merge branch 'zj-object-pool-path' into 'master'Nick Thomas2018-11-283-9/+29
| |\ | | | | | | | | | | | | Rename Repository table to PoolRepository See merge request gitlab-org/gitlab-ce!23236
| | * Rename the Repository table to PoolRepositoryZeger-Jan van de Weg2018-11-273-9/+29
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | To separate the different kinds of repositories we have at GitLab this table will be renamed to pool_repositories. A project can, for now at least, be member of none, or one of these. The table will get additional columns in a later merge request where more logic is implemented for the model. Further included is a small refactor of logic around hashing ids for the disk_path, mainly to ensure a previous implementation is reusable. The disk_path for the pool_repositories table no longer has a NOT NULL constraint, but given the hashing of the ID requires the DB to assign the record an ID, an after_create hook is used to update the value. A related MR is: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/23143, adding tables for 'normal' repositories and wiki_repositories.
* | | Merge branch 'master' into fix/gb/encrypt-runners-tokensGrzegorz Bizon2018-11-281069-1071/+1226
|\ \ \ | |/ / | | | | | | | | | | | | | | | | | | * master: (243 commits) Conflicts: db/schema.rb lib/gitlab/import_export/import_export.yml
| * | Move code to a BackgroundMigrationToon Claes2018-11-271-117/+8
| | | | | | | | | | | | And run in intervals.
| * | Migration to write fullpath in all repository configsToon Claes2018-11-271-0/+136
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/16027 it was added to write `gitlab.fullpath` in the git config of all repositories. But this only writes them on move or migrate to hashed storage. This adds a migration that writes the fullpath to all the repositories. Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/41776
| * | Merge branch '53778-remove-site-statistics' into 'master'Sean McGivern2018-11-272-4/+22
| |\ \ | | |/ | |/| | | | | | | | | | | | | Remove Site Statistic Closes #53778 See merge request gitlab-org/gitlab-ce!23314
| | * Remove Site Statistic53778-remove-site-statisticsGabriel Mazetto2018-11-262-4/+22
| | | | | | | | | | | | | | | This approach caused many different problems as we tightened the query execution timeout.
| * | Merge branch 'triggermesh-phase2-external-ip' into 'master'Kamil Trzciński2018-11-272-0/+15
| |\ \ | | | | | | | | | | | | | | | | Expose External IP address for Knative's gateway See merge request gitlab-org/gitlab-ce!23162
| | * | Expose external_ip to knative cluster applicationChris Baumbauer2018-11-262-0/+15
| | |/
| * | Remove notes index on updated_atLin Jen-Shin2018-11-272-2/+33
| |/
| * Add events index on project_id and created_atLin Jen-Shin2018-11-262-1/+34
| |
| * Merge branch 'certmanager-temp' into 'master'Kamil Trzciński2018-11-232-0/+31
| |\ | | | | | | | | | | | | Deploy cert-manager to managed cluster for SSL certificates See merge request gitlab-org/gitlab-ce!23036
| | * Updated migration filesAmit Rathi2018-11-221-1/+1
| | |
| | * unique: true on cluster_id index on cert_managerAmit Rathi2018-11-222-2/+3
| | |
| | * Merge branch 'master' into certmanager-tempAmit Rathi2018-11-202-2/+16
| | |\
| | * | Updated schema.rb and remove extra char from install_commandAmit Rathi2018-11-201-0/+11
| | | |
| | * | Merge branch 'master' into certmanager-tempAmit Rathi2018-11-194-577/+579
| | |\ \