[bitnami/*] Added the Testing Strategy (#9087)

* Initial commit

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Formatting, adding a reference to the test strategy

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Title formatting

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Removed test types and extra spaces

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/*]: test: 🚸 Make "Early Feedback" run in all PRs (#9077)

Signed-off-by: Javier Salmeron Garcia <jsalmeron@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/zookeeper] Release 8.0.3 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/odoo] Release 20.2.8 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/wavefront] Release 3.1.26 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/grafana-tempo] Release 1.0.3 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/node-exporter] Release 2.4.2 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/dataplatform-bp2] Release 10.0.9 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/airflow] Release 12.0.3 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/apache] Release 9.0.3 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/postgresql-ha] Release 8.4.1 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/osclass] Release 13.0.6 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/rabbitmq] Release 8.29.1 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/testlink] Release 10.0.7 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nginx] Release 9.7.7 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/owncloud] Release 11.0.7 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/influxdb] Release 3.0.3 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/kube-state-metrics] Release 2.2.8 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/metallb] Release 2.6.5 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mongodb-sharded] Release 4.0.4 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/suitecrm] Release 10.0.6 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/grafana-operator] Release 2.2.5 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/airflow] Release 12.0.4 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/wildfly] Release 13.1.5 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/tomcat] Release 10.1.10 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/drupal] Release 11.0.11 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nginx-ingress-controller] Release 9.1.6 updating components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Fix Typo in README (#9031)

* fix typo and bump chart version

Signed-off-by: Sebastian Jäger <message@sebastian-jaeger.me>

* Update Chart.yaml

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/contour] Support namespace-scoped leader election (#9030)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/kubewatch] Chart standardised (#9012)

* [bitnami/kubewatch] Chart standardised

Signed-off-by: Miguel Ruiz <miruiz@vmware.com>

* Add diagnosticMode

Signed-off-by: Miguel Ruiz <miruiz@vmware.com>

* Update README.md

Signed-off-by: Miguel Ruiz <miruiz@vmware.com>

* Move lifecycleHooks

Signed-off-by: Miguel Ruiz <miruiz@vmware.com>

* [bitnami/kubewatch] Update components versions

Signed-off-by: Bitnami Containers <containers@bitnami.com>

Co-authored-by: Bitnami Containers <containers@bitnami.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mariadb-galera] Do not hardcode PDB apiVersion (#9086)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/osclass] Do not hardcode PDB apiVersion (#9113)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/redmine] Do not hardcode PDB apiVersion (#9116)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/thanos] Do not hardcode PDB apiVersion (#9118)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/wordpress] Added the image upload test for Wordpress (#9059)

* Added an upload image test for WordPress

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Removed the tab changes for now for easier review

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Trigger pipeline

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Trigger pipeline

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Trigger pipeline

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/airflow] Do not hardcode PDB apiVersion (#9088)

Signed-off-by: juan131 <juanariza@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/argo-workflows] Do not hardcode PDB apiVersion (#9089)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/aspnet-core] Do not hardcode PDB apiVersion (#9090)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/etcd] Do not hardcode PDB apiVersion (#9094)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/external-dns] Do not hardcode PDB apiVersion (#9095)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/consul] Do not hardcode PDB apiVersion (#9092)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/cassandra] Do not hardcode PDB apiVersion (#9091)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/jupyterhub] Do not hardcode PDB apiVersion (#9096)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/keycloak] Do not hardcode PDB apiVersion (#9097)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/contour] Do not hardcode PDB apiVersion (#9093)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/kong] Do not hardcode PDB apiVersion (#9098)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mariadb] Do not hardcode PDB apiVersion (#9101)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/logstash] Do not hardcode PDB apiVersion (#9100)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/metrics-server] Do not hardcode PDB apiVersion (#9102)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/minio] Do not hardcode PDB apiVersion (#9103)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mongodb-sharded] Do not hardcode PDB apiVersion (#9104)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mongodb] Do not hardcode PDB apiVersion (#9105)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/mysql] Do not hardcode PDB apiVersion (#9106)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nats] Do not hardcode PDB apiVersion (#9107)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nginx-ingress-controller] Do not hardcode PDB apiVersion (#9108)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nginx-intel] Do not hardcode PDB apiVersion (#9109)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/nginx] Do not hardcode PDB apiVersion (#9110)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/oauth2-proxy] Do not hardcode PDB apiVersion (#9111)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/odoo] Do not hardcode PDB apiVersion (#9112)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/redis-cluster] Do not hardcode PDB apiVersion (#9115)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/postgresql-ha] Do not hardcode PDB apiVersion (#9114)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/wordpress-intel] Do not hardcode PDB apiVersion (#9119)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* [bitnami/spring-cloud-dataflow] Do not hardcode PDB apiVersion (#9117)

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Update TESTING.md

Applied the commit suggestion

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Update TESTING.md

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Update TESTING.md

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Update TESTING.md

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Update CONTRIBUTING.md

Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Removed an extra empty line

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Modified as per PR

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Removed extra line

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Cosmetic changes

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Cosmetic changes

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Adding changes per PR

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Removed the testing of the test reference

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Changed the link to Trivy

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Added clarification on test types

Signed-off-by: Aleksandra Lukic <alukic@vmware.com>

* Aded a wider category of tests called integration tests

Signed-off-by: alukic <alukic@vmware.com>

* Added the changes according to EM's feedback

Signed-off-by: alukic <alukic@vmware.com>

* Added the link to helm lint

Signed-off-by: alukic <alukic@vmware.com>

* Rephrased the point 3 in Contributing

Signed-off-by: alukic <alukic@vmware.com>

* Reordered the common test cases

Signed-off-by: alukic <alukic@vmware.com>

Co-authored-by: Javier J. Salmerón-García <jsalmeron@vmware.com>
Co-authored-by: Bitnami Containers <containers@bitnami.com>
Co-authored-by: Sebastian Jäger <message@sebastian-jaeger.me>
Co-authored-by: Carlos Rodríguez Hernández <carlosrh@vmware.com>
Co-authored-by: Maciej Małecki <me@mmalecki.com>
Co-authored-by: Miguel Ruiz <miruiz@vmware.com>
Co-authored-by: Juan Ariza Toledano <juanariza@vmware.com>
This commit is contained in:
superaleks
2022-03-03 08:27:43 +01:00
committed by GitHub
parent 0aa3380b2f
commit 77e8a9fa75
2 changed files with 98 additions and 3 deletions

View File

@@ -2,7 +2,7 @@
Contributions are welcome via GitHub Pull Requests. This document outlines the process to help get your contribution accepted.
Any type of contribution is welcome; from new features, bug fixes, documentation improvements or even [adding charts to the repository](#adding-a-new-chart-to-the-repository) (if it's viable once evaluated the feasibility).
Any type of contribution is welcome; from new features, bug fixes, [tests](#testing), documentation improvements or even [adding charts to the repository](#adding-a-new-chart-to-the-repository) (if it's viable once evaluated the feasibility).
## How to Contribute
@@ -53,13 +53,18 @@ Notice the `Author` and `Signed-off-by` lines match. If they don't your PR will
1. Changes are automatically linted and tested using the [`ct` tool](https://github.com/helm/chart-testing) as a [GitHub action](https://github.com/helm/chart-testing-action). Those tests are based on `helm install`, `helm lint` and `helm test` commands and provide quick feedback about the changes in the PR. For those tests, the chart is installed on top of [kind](https://github.com/kubernetes-sigs/kind) and this step is not blocking (as opposed to 3rd step).
2. Changes are manually reviewed by Bitnami team members.
3. Once the changes are accepted, the PR is tested (if needed) into the Bitnami CI pipeline, the chart is installed and tested (verification and functional tests) on top of different k8s platforms.
3. Once the changes are accepted, the PR is verified with a [Static analysis](https://github.com/bitnami/charts/blob/master/TESTING.md#Static-analysis) that includes the lint and the vulnerability checks. If that passes, the Bitnami team will review the changes and trigger the verification and functional tests.
4. When the PR passes all tests, the PR is merged by the reviewer(s) in the GitHub `master` branch.
5. Then our CI/CD system is going to push the chart to the Helm registry including the recently merged changes and also the latest images and dependencies used by the chart. The changes in the images will be also committed by the CI/CD to the GitHub repository, bumping the chart version again.
***NOTE***: Please note that, in terms of time, may be a slight difference between the appearance of the code in GitHub and the chart in the registry.
[Here](https://docs.bitnami.com/kubernetes/faq/get-started/understand-charts-release-process/) you can find more information about this process.
### Testing
1. Read the [Test Strategy](https://github.com/bitnami/charts/blob/master/TESTING.md) guide.
2. Determine the types of tests you will need based on the chart you are testing and the information in the test strategy.
3. Before you create a pull request, make sure you achieved the [Test Acceptance Criteria](https://github.com/bitnami/charts/blob/master/TESTING.md#Test-acceptance-criteria).
4. If you were able to achieve them, congrats! Create a PR and wait for the approval. You should then be able to see the result of the test execution for multiple cloud platforms (AKS, TKG, GKE) after the approval.
### Adding a new chart to the repository