991 Commits

Author SHA1 Message Date
burnettk
3d5c60b14b
why not dict, too 2023-02-22 14:36:26 -05:00
Jon Herron
7d682617c8 Cleanup 2023-02-22 13:42:45 -05:00
Jon Herron
dbd0db60e8 Getting ./bin/pyl to pass 2023-02-22 13:34:26 -05:00
Jon Herron
72f7b1fc27 Provide info about keys in task data and python env 2023-02-22 13:13:28 -05:00
Jon Herron
19879135e5 Unfactor to fix size calculation/type hint issues 2023-02-22 11:17:23 -05:00
Jon Herron
ef7f78a366 Getting ./bin/pyl to pass 2023-02-22 11:04:07 -05:00
Jon Herron
879371255f Adding python env size 2023-02-22 10:55:09 -05:00
Jon Herron
1c6439ab59 Add cumulative task data size to script 2023-02-22 10:39:35 -05:00
burnettk
9a45183267
remove start and end events from simple logs view 2023-02-21 22:43:23 -05:00
burnettk
7ae03bec27
copy env so we are doing additive stuff rather than completely rewriting it 2023-02-21 22:00:02 -05:00
jasquat
e506c37265
fix git bash script unbound error w/ burnettk 2023-02-21 17:08:09 -05:00
jasquat
d059665431
more git config updates w/ burnettk 2023-02-21 16:43:52 -05:00
jasquat
df3b713ce4
disable strict host checking for git commands w/ burnettk 2023-02-21 16:42:11 -05:00
jasquat
b8b4734aea
fixed tests w/ burnettk 2023-02-21 15:28:54 -05:00
jasquat
2e0be30cbe
give access to download process data files if a user has access to start a process model w/ burnettk 2023-02-21 15:08:19 -05:00
b0a9f440cb
backend: create SSH key file when contents provided
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 20:02:16 +01:00
e54965f8ec
backend: use sensible lock filename for git
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:39 +01:00
72a29aa327
backend: specify --rebase when using git pull
Otherwise it fails with:
```
Pulling without specifying how to reconcile divergent branches is discouraged.
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:38 +01:00
2f88ba3013
backend: fix use of SSH private key for git ops
Primarily this is supposed to fix the `git pull` aciton triggered by
webhooks from GitHub. But in addition to that the point is to simplify
that committing wrapper which has far too much in it.

Instead of passing everything as CLI arguments one should make use of
already supported environment variables and the `env` argument to
`subprocess` functions like `run()`. Writing extra logic in the wrapper
only makes it unnecessarily complicated.

By passing both user, email, and the SSH options in `run_shell_command`
we avoid the need to repeat the same boilerplate to provide Git config
and SSH credentials.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:36 +01:00
jbirddog
c6131d1a3f
Look in task data/script engine environment for data, not just workflow data. (#143) 2023-02-20 18:12:50 -05:00
Dan
7b16625cff run_pyl 2023-02-20 12:34:42 -05:00
Dan
5171e53240 * SpiffWorkflow event_definitions wanted to return a message event's correlation properties mested within correlation keys. But messages are directly related to properties, not to keys - and it forced a number of conversions that made for tricky code. So Messages now contain a dictionary of correlation properties only.
* SpiffWorkflow did not serialize correlations - so they were lost between save and retrieve.

* When comparing Correlation Property values - we are storing these values as strings in the database and can't convert them back to integers later, so I'm changing everying everywhere to compare after conversion to a string.  Don't feel great about this one.
* By using an SQL Alchemy join table, there is a lot of db queries we don't need to write.
* A few handy fucntions on db models to make it easier to work with correlations.
* Updated tests because I changed some of the BPMN models we were testing against.
* Database migration to use the new constraint names with the alternate form of the join table between correlation mesages to instance messages.
2023-02-20 11:50:35 -05:00
burnettk
5704c96356
delint 2023-02-20 10:58:04 -05:00
d4a90e208b
backend/git_service: accept webhook test requests
https://docs.github.com/en/webhooks-and-events/webhooks/testing-webhooks

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:11:21 +01:00
a79d25f7e7
backend/git_service: check repo URLs from webhook
Since we are cloning a private repo we are using `ssh_url` in our case.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:02:54 +01:00
Dan
6e7f36e55f Allow people to run commands like "flask db upgrade" without setting specific environment variables like FLASK_SESSION_SECRET_KEY everytime - they just need to add in their own /instance/config.py with their local configuration. 2023-02-19 10:37:00 -05:00
Dan
28ac9ef872 * Re-work message tests so I could wrap my simple head around what was happening - just needed an example that made sense to me.
* Clear out complex get_message_instance_receive how that many-to-many works.
* Create decent error messages when correlations fail
* Move correlation checks into the MessageInstance class
* The APIError could bomb out ugly if it hit a workflow exception with not Task Spec.
2023-02-18 13:09:58 -05:00
Dan
2cf38abedc bump spiffworkflow hash 2023-02-17 13:08:45 -05:00
Dan
4958dbf895 failing test. 2023-02-17 12:10:32 -05:00
Dan
50d3ee544b Merge branch 'main' into feature/message_fixes 2023-02-17 12:01:38 -05:00
Dan
948deb97bc work in progress -
* Link between message instance and correlations is now a link table and many-to-many relationships as recommended by SQLAlchemy
* Use the correlation keys, not the process id when accepting api messages.
2023-02-17 10:45:01 -05:00
jasquat
bf6052d2cb
put the env vars in the env section of the github action configs w/ burnettk 2023-02-16 15:19:01 -05:00
jasquat
311a5b060d
added test for quickstart guide w/ burnettk 2023-02-16 15:05:55 -05:00
jasquat
012396b01e
pyl 2023-02-16 14:38:19 -05:00
jasquat
c48bb712e8
Merge remote-tracking branch 'origin/main' into feature/support_local_openid_in_cypress_tests 2023-02-16 14:25:51 -05:00
burnettk
6f0c977f7e
use _GIT_SOURCE_BRANCH instead of _GIT_BRANCH 2023-02-16 14:10:31 -05:00
burnettk
af45ca4301
fix unprefixed config 2023-02-16 13:56:48 -05:00
burnettk
93da627b24
update configs for publish feature 2023-02-16 13:47:26 -05:00
jasquat
5342b50bac
added some support for using the backend openid server for cypress tests w/ burnettk 2023-02-16 12:09:44 -05:00
burnettk
9a88dc2d81
add new uses and delete ppg.ba.sme1 2023-02-16 11:53:08 -05:00
jasquat
f004db1562
the equal sign is not apart of the env var w/ burnettk 2023-02-16 11:18:50 -05:00
jasquat
1fd086f055
updated terraform deployed env config name w/ burnettk 2023-02-16 10:51:05 -05:00
jasquat
59a166ddf6
more config updates w/ burnettk 2023-02-16 10:21:02 -05:00
jasquat
e1b71d5267
cleaned up the default config file a bit 2023-02-16 09:05:40 -05:00
jasquat
bb0ac42fe5
pyl 2023-02-16 08:33:39 -05:00
jasquat
fb5d902ce4
fixed some env vars for ci 2023-02-16 07:59:51 -05:00
jasquat
1f2a5e2ddf
pyl 2023-02-16 07:39:40 -05:00
jasquat
47807a6a0c
Merge remote-tracking branch 'origin/main' into feature/update_configs_with_prefix 2023-02-16 07:17:39 -05:00
burnettk
78fee35028
remove unused import 2023-02-16 06:34:03 -05:00
burnettk
84c77395d4
all tests pass w/ spiff lib upgrade, thanks for the help elizabeth 2023-02-15 22:56:12 -05:00