summaryrefslogtreecommitdiff
path: root/doc
Commit message (Collapse)AuthorAgeFilesLines
* Fix Typo in environment create definitionLee Matos2017-11-151-1/+1
|
* Resolve "npm list errors for gitlab-svgs and node-pre-gyp"Tim Zallmann2017-11-151-1/+1
|
* Merge branch 'update-emoji-digests-with-latest-from-gemojione' into 'master'Filipa Lacerda2017-11-153-0/+38
|\ | | | | | | | | | | | | Update Emoji digests and assets with latest from Gemojione v3.3.0 Closes #32634 See merge request gitlab-org/gitlab-ce!15390
| * Add basic emoji development docsEric Eastwood2017-11-152-0/+28
| |
| * Regenerate emoji digests with latest gemojioneEric Eastwood2017-11-141-0/+10
| |
* | Merge branch 'fix-typo' into 'master'Sean McGivern2017-11-151-1/+1
|\ \ | | | | | | | | | | | | fix typo See merge request gitlab-org/gitlab-ce!15374
| * | Update getting_started_part_one.mdChế Tiệp Chân Khoa2017-11-141-1/+1
| | |
* | | Merge branch 'patch-2' into 'master'Achilleas Pipinellis2017-11-151-1/+1
|\ \ \ | | | | | | | | | | | | | | | | Replace 'charts' with 'chart' See merge request gitlab-org/gitlab-ce!15385
| * | | Replace 'charts' with 'chart'Nestor Pestelos2017-11-151-1/+1
| | |/ | |/| | | | | | | | | | | | | Auto DevOps' gitlab-ci.yml expects a directory named 'chart'. See also: https://gitlab.com/gitlab-org/gitlab-ci-yml/merge_requests/114
* | | Merge branch '38007-update-licensing-docs' into 'master'Achilleas Pipinellis2017-11-151-3/+3
|\ \ \ | |/ / |/| | | | | | | | | | | | | | Update licensing docs to clarify process for node modules Closes #38007 See merge request gitlab-org/gitlab-ce!14575
| * | update licensing docs to mention that we check node_modules for license ↵38007-update-licensing-docsMike Greiling2017-09-291-3/+3
| | | | | | | | | | | | information as well
* | | Merge branch 'update-metrics-for-k8s-1.7' into 'master'Tim Zallmann2017-11-141-2/+2
|\ \ \ | | | | | | | | | | | | | | | | Update queries to remove duplicate entries (CE version) See merge request gitlab-org/gitlab-ce!15254
| * | | Uodate docsupdate-metrics-for-k8s-1.7Joshua Lambert2017-11-121-2/+2
| | | |
* | | | Merge branch 'fix/sm/31771-do-not-allow-jobs-to-be-erased-new' into 'master'Kamil Trzciński2017-11-141-0/+2
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Do not allow jobs to be erased Closes #31771 See merge request gitlab-org/gitlab-ce!15216
| * \ \ \ Merge branch 'master' into fix/sm/31771-do-not-allow-jobs-to-be-erased-newShinya Maeda2017-11-0710-16/+89
| |\ \ \ \
| * | | | | Add doc. Fix spec. Add erase_build in protected_ref ruleShinya Maeda2017-11-071-0/+2
| | | | | |
* | | | | | Update limit_ee_conflicts.md with assets/gitlab-svgs conflict resolution.limit_ee_conflicts-gitlab-svgsLuke "Jared" Bennett2017-11-131-0/+6
| | | | | |
* | | | | | Add administrative endpoint to list all pages domainsTravis Miller2017-11-131-0/+25
| | | | | |
* | | | | | Update Services API documentation for Kubernetes serviceupdate-services-api-docs-for-kubernetesAthar Hameed2017-11-131-0/+35
| | | | | |
* | | | | | Merge branch 'docs-40038-broken-link-on-projects-members-documentation-site' ↵Marcia Ramos2017-11-131-1/+1
|\ \ \ \ \ \ | |_|_|/ / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | into 'master' Fix permissions link for project member docs Closes #40038 See merge request gitlab-org/gitlab-ce!15325
| * | | | | Fix permissions link for project member docsMark Fletcher2017-11-101-1/+1
| | | | | |
* | | | | | Add Update guide for 10.2Winnie Hellmann2017-11-101-0/+360
| | | | | |
* | | | | | Update installation.md to 10-2-stablewinh-installation-10-2-stable-docswinh-installation-10-2-stableWinnie Hellmann2017-11-101-2/+2
|/ / / / /
* | | | | Merge branch 'br-add-glossary' into 'master'Sid Sijbrandij2017-11-091-16/+133
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | add glossary part 1 See merge request gitlab-org/gitlab-ce!15247
| * | | | | add glossary part 2br-add-glossaryBrittany Rohde2017-11-071-3/+3
| | | | | |
| * | | | | add glossary part 1Brittany Rohde2017-11-071-13/+130
| | |/ / / | |/| | |
* | | | | Add /groups/:id/subgroups endpoint to APIWinnie Hellmann2017-11-091-4/+45
| | | | |
* | | | | Fix acceptance of username for Mattermost service update via APIMark Fletcher2017-11-081-1/+1
| | | | |
* | | | | Merge branch 'fix/doc/39935-missing-fields-in-merge-request-payload' into ↵Achilleas Pipinellis2017-11-081-0/+6
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 'master' Fix issue 39935 : Add created_at and updated_at fields in MR payload Closes #39935 See merge request gitlab-org/gitlab-ce!15274
| * | | | | Fix issue 39935 : Add created_at and updated_atSébastien Le Gall2017-11-081-0/+6
| |/ / / / | | | | | | | | | | | | | | | Add those fields to the documentation payload about merge requests that were missing but actually present when calling the endpoints
* | | | | Merge branch 'update-upload-documentation' into 'master'Nick Thomas2017-11-082-10/+59
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | Added file storage documentation and updated hash storage one See merge request gitlab-org/gitlab-ce!15269
| * | | | | Added file storage documentation and updated hash storage oneGabriel Mazetto2017-11-082-10/+59
| | | | | |
* | | | | | Merge branch 'bvl-update-externalization-docs' into 'master'Achilleas Pipinellis2017-11-081-15/+12
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Make a note of which files to check in after externalizing strings See merge request gitlab-org/gitlab-ce!15207
| * | | | | | Make a note of which files to check in after externalizing stringsbvl-update-externalization-docsBob Van Landuyt2017-11-081-15/+12
| | | | | | |
* | | | | | | Merge branch 'github-importer-refactor' into 'master'Douwe Maan2017-11-085-1/+340
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Rewrite the GitHub importer to perform work in parallel and greatly improve performance Closes #33135, #38621, and #39361 See merge request gitlab-org/gitlab-ce!14731
| * | | | | | | Rewrite the GitHub importer from scratchYorick Peterse2017-11-075-1/+340
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Prior to this MR there were two GitHub related importers: * Github::Import: the main importer used for GitHub projects * Gitlab::GithubImport: importer that's somewhat confusingly used for importing Gitea projects (apparently they have a compatible API) This MR renames the Gitea importer to Gitlab::LegacyGithubImport and introduces a new GitHub importer in the Gitlab::GithubImport namespace. This new GitHub importer uses Sidekiq for importing multiple resources in parallel, though it also has the ability to import data sequentially should this be necessary. The new code is spread across the following directories: * lib/gitlab/github_import: this directory contains most of the importer code such as the classes used for importing resources. * app/workers/gitlab/github_import: this directory contains the Sidekiq workers, most of which simply use the code from the directory above. * app/workers/concerns/gitlab/github_import: this directory provides a few modules that are included in every GitHub importer worker. == Stages The import work is divided into separate stages, with each stage importing a specific set of data. Stages will schedule the work that needs to be performed, followed by scheduling a job for the "AdvanceStageWorker" worker. This worker will periodically check if all work is completed and schedule the next stage if this is the case. If work is not yet completed this worker will reschedule itself. Using this approach we don't have to block threads by calling `sleep()`, as doing so for large projects could block the thread from doing any work for many hours. == Retrying Work Workers will reschedule themselves whenever necessary. For example, hitting the GitHub API's rate limit will result in jobs rescheduling themselves. These jobs are not processed until the rate limit has been reset. == User Lookups Part of the importing process involves looking up user details in the GitHub API so we can map them to GitLab users. The old importer used an in-memory cache, but this obviously doesn't work when the work is spread across different threads. The new importer uses a Redis cache and makes sure we only perform API/database calls if absolutely necessary. Frequently used keys are refreshed, and lookup misses are also cached; removing the need for performing API/database calls if we know we don't have the data we're looking for. == Performance & Models The new importer in various places uses raw INSERT statements (as generated by `Gitlab::Database.bulk_insert`) instead of using Rails models. This allows us to bypass any validations and callbacks, drastically reducing the number of SQL queries and Gitaly RPC calls necessary to import projects. To ensure the code produces valid data the corresponding tests check if the produced rows are valid according to the model validation rules.
* | | | | | | | Merge branch 'ux-guide-components-modal' into 'master'Marcia Ramos2017-11-085-0/+33
|\ \ \ \ \ \ \ \ | |_|_|/ / / / / |/| | | | | | | | | | | | | | | | | | | | | | | Modals in UX guide See merge request gitlab-org/gitlab-ce!14886
| * | | | | | | Changed the order of buttons from left to rightux-guide-components-modalHazel2017-11-061-1/+2
| | | | | | | |
| * | | | | | | Modify the sentences and add TodoHazel2017-11-021-2/+4
| | | | | | | |
| * | | | | | | Modified the font family in the imagesHazel2017-10-186-1/+1
| | | | | | | |
| * | | | | | | Updated the sytle part - changed the order of header, body, and actionsHazel2017-10-171-3/+3
| | | | | | | |
| * | | | | | | Updated the content and added the imagesHazel2017-10-176-11/+12
| | | | | | | |
| * | | | | | | Modified the copyHazel2017-10-161-1/+1
| | | | | | | |
| * | | | | | | Draft a guide of modals in UX guideHazel2017-10-161-0/+29
| | | | | | | |
* | | | | | | | Add note on registry restrictions on GitLab.comChenjerai Katanda2017-11-071-1/+2
| |/ / / / / / |/| | | | | |
* | | | | | | Improve GitLab Import rake task to work with Hashed Storage and SubgroupsJames Lopez2017-11-071-22/+25
| | | | | | |
* | | | | | | Merge branch 'master' into 38464-k8s-appsShinya Maeda2017-11-081-6/+20
|\ \ \ \ \ \ \
| * | | | | | | issue ordering docsVictor Wu2017-11-071-6/+20
| | |_|/ / / / | |/| | | | |
* | | | | | | Merge branch 'master' into 38464-k8s-appsShinya Maeda2017-11-078-15/+75
|\ \ \ \ \ \ \ | |/ / / / / /
| * | | | | | Merge branch 'feature/custom-attributes-on-projects-and-groups' into 'master'Rémy Coutable2017-11-073-8/+31
| |\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Support custom attributes on groups and projects See merge request gitlab-org/gitlab-ce!14593