Commit Graph

1159 Commits

Author SHA1 Message Date
jasquat 3eb15527fb
added comment about refactoring getting task data w/ burnettk jbirddog 2023-02-23 15:06:23 -05:00
burnettk 0897635c5f
lint 2023-02-23 15:01:45 -05:00
burnettk 470e0002cd
add test users 2023-02-23 14:58:14 -05:00
Dan 0b6596cad4 Adding Migration. 2023-02-23 14:42:00 -05:00
jasquat 9b88241882
remove task size check since it can take a long time to run and we do not do anything with it w/ burnettk jbirddog 2023-02-23 14:41:45 -05:00
Dan 9bf32a7560 Merge remote-tracking branch 'origin/main' into feature/message_fixes 2023-02-23 14:26:04 -05:00
Dan aa8c5022ea run_pyl 2023-02-23 14:17:22 -05:00
Dan 8c673c4fb6 BPMN.io -- Just show the message names not the ids - to assure we are only exposing the names.
SpiffWorkflow -
    - start_messages function should return message names, not ids.
    - don't catch external thrown messages within the same workflow process
    - add an expected value to the Correlation Property Model so we can use this well defined class as an external communication tool (rather than building an arbitrary dictionary)
    - Added a "get_awaiting_correlations" to an event, so we can get a list of the correlation properties related to the workflows currently defined correlation values.
    - workflows.waiting_events() function now returns the above awaiting correlations as the value on returned message events
 Backend
    - Dropping MessageModel and MessageCorrelationProperties - at least for now.  We don't need them to send / receive messages though we may eventually want to track the messages and correlations defined across the system - these things (which are ever changing) should not be directly connected to the Messages which may be in flux - and the cross relationships between the tables could cause unexpected and unceissary errors.  Commented out the caching logic so we can turn this back on later.
    - Slight improvement to API Errors
    - MessageInstances are no longer in a many-to-many relationship with Correlations - Each message instance has a unique set of message correlations specific to the instance.
    - Message Instances have users, and can be linked through a "counterpart_id" so you can see what send is connected to what recieve.
    - Message Correlations are connected to  recieving message instances.  It is not to a process instance, and not to a message model.  They now include the expected value and retrieval expression required to validate an incoming message.
    - A process instance is not connected to message correlations.
    - Message Instances are not always tied to a process instance (for example, a Send Message from an API)
    - API calls to create a message use the same logic as all other message catching code.
    - Make use of the new waiting_events() method to check for any new recieve messages in the workflow (much easier than
    churning through all of the tasks)
    - One giant mother of a migration.
2023-02-23 13:53:03 -05:00
jasquat e4431500fc
do not call serialize if we can use the cached bpmn_json instead w/ burnettk 2023-02-23 13:48:27 -05:00
jasquat b8becd1b76
Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-23 11:19:26 -05:00
jasquat 6632f9fde2
turn on sentry detailed tracing for task-data w/ burnettk 2023-02-23 11:19:22 -05:00
burnettk a59ce277a3
update spiff 2023-02-23 11:02:40 -05:00
Kevin Burnett 8d07643586
Merge pull request #145 from sartography/data_size_script
Data size script
2023-02-22 17:36:31 -08:00
jasquat ba51b780ef
Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-22 15:35:02 -05:00
jasquat 68f4868692
set git user configs explicitly using the env vars w/ burnettk 2023-02-22 15:34:47 -05:00
burnettk e5da1ca50d
so we do not lose our minds when debugging on a server 2023-02-22 15:16:13 -05:00
jasquat 1d6c0c4eea
Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-22 14:42:46 -05:00
jasquat ccccf8bf96
show help text for textareas as well w/ burnettk 2023-02-22 14:42:43 -05:00
burnettk 3d5c60b14b
why not dict, too 2023-02-22 14:36:26 -05:00
Jon Herron 7d682617c8 Cleanup 2023-02-22 13:42:45 -05:00
Jon Herron dbd0db60e8 Getting ./bin/pyl to pass 2023-02-22 13:34:26 -05:00
Jon Herron 72f7b1fc27 Provide info about keys in task data and python env 2023-02-22 13:13:28 -05:00
Jon Herron 19879135e5 Unfactor to fix size calculation/type hint issues 2023-02-22 11:17:23 -05:00
Jon Herron ef7f78a366 Getting ./bin/pyl to pass 2023-02-22 11:04:07 -05:00
Jon Herron 879371255f Adding python env size 2023-02-22 10:55:09 -05:00
Jon Herron 1c6439ab59 Add cumulative task data size to script 2023-02-22 10:39:35 -05:00
burnettk 9a45183267
remove start and end events from simple logs view 2023-02-21 22:43:23 -05:00
burnettk 7ae03bec27
copy env so we are doing additive stuff rather than completely rewriting it 2023-02-21 22:00:02 -05:00
jasquat e506c37265
fix git bash script unbound error w/ burnettk 2023-02-21 17:08:09 -05:00
jasquat d059665431
more git config updates w/ burnettk 2023-02-21 16:43:52 -05:00
jasquat df3b713ce4
disable strict host checking for git commands w/ burnettk 2023-02-21 16:42:11 -05:00
jasquat b8b4734aea
fixed tests w/ burnettk 2023-02-21 15:28:54 -05:00
jasquat 2e0be30cbe
give access to download process data files if a user has access to start a process model w/ burnettk 2023-02-21 15:08:19 -05:00
Jakub Sokołowski b0a9f440cb
backend: create SSH key file when contents provided
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 20:02:16 +01:00
Jakub Sokołowski e54965f8ec
backend: use sensible lock filename for git
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:39 +01:00
Jakub Sokołowski 72a29aa327
backend: specify --rebase when using git pull
Otherwise it fails with:
```
Pulling without specifying how to reconcile divergent branches is discouraged.
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:38 +01:00
Jakub Sokołowski 2f88ba3013
backend: fix use of SSH private key for git ops
Primarily this is supposed to fix the `git pull` aciton triggered by
webhooks from GitHub. But in addition to that the point is to simplify
that committing wrapper which has far too much in it.

Instead of passing everything as CLI arguments one should make use of
already supported environment variables and the `env` argument to
`subprocess` functions like `run()`. Writing extra logic in the wrapper
only makes it unnecessarily complicated.

By passing both user, email, and the SSH options in `run_shell_command`
we avoid the need to repeat the same boilerplate to provide Git config
and SSH credentials.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:36 +01:00
jbirddog c6131d1a3f
Look in task data/script engine environment for data, not just workflow data. (#143) 2023-02-20 18:12:50 -05:00
Dan 7b16625cff run_pyl 2023-02-20 12:34:42 -05:00
Dan 5171e53240 * SpiffWorkflow event_definitions wanted to return a message event's correlation properties mested within correlation keys. But messages are directly related to properties, not to keys - and it forced a number of conversions that made for tricky code. So Messages now contain a dictionary of correlation properties only.
* SpiffWorkflow did not serialize correlations - so they were lost between save and retrieve.

* When comparing Correlation Property values - we are storing these values as strings in the database and can't convert them back to integers later, so I'm changing everying everywhere to compare after conversion to a string.  Don't feel great about this one.
* By using an SQL Alchemy join table, there is a lot of db queries we don't need to write.
* A few handy fucntions on db models to make it easier to work with correlations.
* Updated tests because I changed some of the BPMN models we were testing against.
* Database migration to use the new constraint names with the alternate form of the join table between correlation mesages to instance messages.
2023-02-20 11:50:35 -05:00
burnettk 5704c96356
delint 2023-02-20 10:58:04 -05:00
Jakub Sokołowski d4a90e208b
backend/git_service: accept webhook test requests
https://docs.github.com/en/webhooks-and-events/webhooks/testing-webhooks

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:11:21 +01:00
Jakub Sokołowski a79d25f7e7
backend/git_service: check repo URLs from webhook
Since we are cloning a private repo we are using `ssh_url` in our case.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:02:54 +01:00
Dan 6e7f36e55f Allow people to run commands like "flask db upgrade" without setting specific environment variables like FLASK_SESSION_SECRET_KEY everytime - they just need to add in their own /instance/config.py with their local configuration. 2023-02-19 10:37:00 -05:00
Dan 28ac9ef872 * Re-work message tests so I could wrap my simple head around what was happening - just needed an example that made sense to me.
* Clear out complex get_message_instance_receive how that many-to-many works.
* Create decent error messages when correlations fail
* Move correlation checks into the MessageInstance class
* The APIError could bomb out ugly if it hit a workflow exception with not Task Spec.
2023-02-18 13:09:58 -05:00
Dan 2cf38abedc bump spiffworkflow hash 2023-02-17 13:08:45 -05:00
Dan 4958dbf895 failing test. 2023-02-17 12:10:32 -05:00
Dan 50d3ee544b Merge branch 'main' into feature/message_fixes 2023-02-17 12:01:38 -05:00
Dan 948deb97bc work in progress -
* Link between message instance and correlations is now a link table and many-to-many relationships as recommended by SQLAlchemy
* Use the correlation keys, not the process id when accepting api messages.
2023-02-17 10:45:01 -05:00
jasquat bf6052d2cb
put the env vars in the env section of the github action configs w/ burnettk 2023-02-16 15:19:01 -05:00
jasquat 311a5b060d
added test for quickstart guide w/ burnettk 2023-02-16 15:05:55 -05:00
jasquat 012396b01e
pyl 2023-02-16 14:38:19 -05:00
jasquat c48bb712e8
Merge remote-tracking branch 'origin/main' into feature/support_local_openid_in_cypress_tests 2023-02-16 14:25:51 -05:00
burnettk 6f0c977f7e
use _GIT_SOURCE_BRANCH instead of _GIT_BRANCH 2023-02-16 14:10:31 -05:00
burnettk af45ca4301
fix unprefixed config 2023-02-16 13:56:48 -05:00
burnettk 93da627b24
update configs for publish feature 2023-02-16 13:47:26 -05:00
jasquat 5342b50bac
added some support for using the backend openid server for cypress tests w/ burnettk 2023-02-16 12:09:44 -05:00
burnettk 9a88dc2d81
add new uses and delete ppg.ba.sme1 2023-02-16 11:53:08 -05:00
jasquat f004db1562
the equal sign is not apart of the env var w/ burnettk 2023-02-16 11:18:50 -05:00
jasquat 1fd086f055
updated terraform deployed env config name w/ burnettk 2023-02-16 10:51:05 -05:00
jasquat 59a166ddf6
more config updates w/ burnettk 2023-02-16 10:21:02 -05:00
jasquat e1b71d5267
cleaned up the default config file a bit 2023-02-16 09:05:40 -05:00
jasquat bb0ac42fe5
pyl 2023-02-16 08:33:39 -05:00
jasquat fb5d902ce4
fixed some env vars for ci 2023-02-16 07:59:51 -05:00
jasquat 1f2a5e2ddf
pyl 2023-02-16 07:39:40 -05:00
jasquat 47807a6a0c
Merge remote-tracking branch 'origin/main' into feature/update_configs_with_prefix 2023-02-16 07:17:39 -05:00
burnettk 78fee35028
remove unused import 2023-02-16 06:34:03 -05:00
burnettk 84c77395d4
all tests pass w/ spiff lib upgrade, thanks for the help elizabeth 2023-02-15 22:56:12 -05:00
burnettk 608efeb565
format 2023-02-15 22:35:55 -05:00
jasquat 3abd4c92c6
updated remaining configs manually w/ burnettk 2023-02-15 17:21:37 -05:00
jasquat 78360de25f
updated secret config names as well w/ burnettk 2023-02-15 17:17:47 -05:00
jasquat 497389ceb9
updated configs to use the prefix using the script w/ burnettk 2023-02-15 17:07:12 -05:00
jasquat f9a7e40488
updated default user group var name for better prefix w/ burnettk 2023-02-15 16:43:40 -05:00
jasquat a6a1f06941
save task data to spiff step details when copmleting a user task as well w/ burnettk jbirddog 2023-02-15 15:34:51 -05:00
jasquat 3a00f09baa append OPEN_ID to TENANT_SPECIFIC_FIELDS for clarification on what it is from w/ burnettk 2023-02-15 11:12:30 -05:00
jasquat c8801094a5 do not remove the default user group when refreshing permissions w/ burnettk 2023-02-15 11:09:04 -05:00
Dan 66eba786af Merge branch 'main' of github.com:sartography/spiff-arena into main 2023-02-14 19:39:46 -05:00
Dan c1c5d02547 The aud in a json web token can be a string or an array -- so also deal with the case that it is an array 2023-02-14 19:39:35 -05:00
jasquat 4f7b2bdc8a updates to user import scripts w/ burnettk 2023-02-14 17:39:42 -05:00
jasquat 18a1b83e60 commit user if it has changed any attributes w/ burnettk 2023-02-14 15:08:25 -05:00
jasquat f7f7b60eb6 fix for mypy on python 3.9 w/ burnettk 2023-02-14 11:34:45 -05:00
jasquat 386f1c926d give some leeway to iat when validating auth w/ burnettk 2023-02-14 10:51:11 -05:00
jasquat 6e49fcc975 add in debug logging when failing to login to help debug auth failures 2023-02-14 09:59:29 -05:00
jbirddog 2eab56525a
Don't try to complete a ready task to move the process instance diagram to the next yellow. (#136) 2023-02-13 18:52:06 -05:00
Dan Funk 4e27d5c6e7
Merge pull request #137 from sartography/failing_test
Check the End Event to fix the failing test
2023-02-13 17:04:32 -05:00
jasquat c3713e6d94 allow overriding keycloak url in add user script w/ burnettk 2023-02-13 16:16:43 -05:00
jasquat 047605a282 updated add test users script to use realm admin w/ burnettk 2023-02-13 16:04:57 -05:00
Jon Herron 1c95d2f234 The End Event has a spiff step 2023-02-13 14:13:34 -05:00
jasquat b06929ec08 added script to import users w/ burnettk 2023-02-13 12:15:00 -05:00
jasquat a39ae63bde added api endpoint to allow logging in for the first time with an openid access_token w/ burnettk 2023-02-13 11:57:31 -05:00
Dan Funk 69f85aad6b
Merge pull request #135 from sartography/bug/len
This should fix the len issue - though there may be better ways to fix
2023-02-13 10:38:32 -05:00
Dan 03f8b62599 run_pyl 2023-02-13 10:38:21 -05:00
burnettk 525536ab6e delete 15 users that are no longer needed 2023-02-13 10:36:03 -05:00
Dan 9a0880f281 Merge remote-tracking branch 'origin/main' into bug/len 2023-02-13 10:35:20 -05:00
burnettk c7a13762c8 commit before removing users 2023-02-13 10:30:07 -05:00
Dan 674380001f This should fix the len issue - though there may be better ways to fix
this.
This reverts commit d1e2d29211.
2023-02-13 10:13:51 -05:00
Dan d1e2d29211 Revert "more finally for better len"
This reverts commit 44e2e91078.
2023-02-13 10:12:31 -05:00
Dan 44e2e91078 more finally for better len
added a fixme for raising errors
fixed up an error message
2023-02-13 10:10:23 -05:00
burnettk 1ccb3b218f fix employee id 2023-02-12 23:43:56 -05:00
Dan 138cd1f940 Update Spiffworkflow so we have the better error messages on service tasks. 2023-02-12 16:19:40 -05:00
Dan 44df269eac don't default to a broken environment. 2023-02-12 15:00:17 -05:00
burnettk 388fcfb42a add five test users, rename peopleops users, delete two 2023-02-12 13:35:09 -05:00
Dan 29dd65b5ad Remove version from docker-compose, as this is causing issues for people still using docker-compose v2. 2023-02-12 12:24:25 -05:00
burnettk be44af5ddf turn off profiling for now to see if that is what is causing segfaults 2023-02-10 09:52:23 -05:00
jbirddog ddcecb21c4
Save logs in finally (#134) 2023-02-10 09:18:04 -05:00
jasquat fd8134706d link to the spiff step from a task on the frontend and use the correct db in ci 2023-02-09 17:07:36 -05:00
jasquat ac9813790c pyl w/ burnettk 2023-02-09 16:03:26 -05:00
jasquat b8870601d1 call activities are also working w/ burnettk 2023-02-09 15:52:00 -05:00
jasquat d99598f5c0 tasks and subprocesses can are setting the task states properly now when getting task data w/ burnettk jbirddog 2023-02-09 15:29:45 -05:00
jasquat e9ee885efb pyl w/ burnettk 2023-02-09 10:28:36 -05:00
Jon Herron bec263d24d Merge branch 'save_step_data' of github.com:sartography/spiff-arena into save_step_data 2023-02-09 09:45:50 -05:00
Jon Herron ffb468d6bb Fix bug where deletes from the environment were not removed from the task data as well 2023-02-09 09:45:31 -05:00
jasquat 8796e42d5e Merge remote-tracking branch 'origin/main' into save_step_data 2023-02-09 09:37:03 -05:00
Dan Funk 81da8c30a6
Merge pull request #132 from sartography/feature/no_more_current_user
Feature/no more current user
2023-02-08 18:23:25 -05:00
jasquat 03d163b1e0 updated controller to use spiff step details to find correct task data to show w/ burnettk 2023-02-08 17:31:20 -05:00
Dan 9eb2eb28df run_pyl 2023-02-08 17:10:57 -05:00
Dan 23403acd29 remove the "current_user" from being added to the task_data. 2023-02-08 15:53:14 -05:00
jasquat ba570d0eff Merge remote-tracking branch 'origin/main' into save_step_data 2023-02-08 14:08:27 -05:00
jasquat 677a5924e9 Merge remote-tracking branch 'origin/main' into save_step_data 2023-02-08 14:02:24 -05:00
burnettk 29f96ff68d pyl 2023-02-08 14:02:17 -05:00
Dan Funk 2814550872
Merge pull request #131 from sartography/feature/improved_service_task_errors
Feature/improved service task errors
2023-02-08 13:38:51 -05:00
Dan 7c7e2d6915 If you have an instance/config.py to override local development it would also override testing. 2023-02-08 13:37:56 -05:00
Dan f9372effd9 Use a mock when making external calls in tests. 2023-02-08 13:14:42 -05:00
Dan 84c74e010a Merge remote-tracking branch 'origin/main' into feature/improved_service_task_errors 2023-02-08 13:11:53 -05:00
burnettk 3539581f1f Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-08 12:51:52 -05:00
burnettk 558c593607 catch up with environment change 2023-02-08 12:51:48 -05:00
jasquat 22dad8ac8a added additional columns to spiff_step_details w/ burnettk jbirddog 2023-02-08 12:43:30 -05:00
Dan 4c7dfaffa6 fixing some missing types 2023-02-08 12:27:55 -05:00
Dan f387ab6c6c run_pyl 2023-02-08 12:00:27 -05:00
Dan d97fcfd238 Assure that when something goes wrong calling a service task that we get as much good information about the problem as possible. 2023-02-08 11:53:20 -05:00
jasquat dc4dfdb788 Merge remote-tracking branch 'origin/main' into save_step_data 2023-02-08 11:47:11 -05:00
jasquat 16b2c96171 enable faulthandler to hopefully see seg faults in the logs w/ burnettk jbirddog 2023-02-08 11:42:11 -05:00
Jon Herron fb1e2abb0d Merge branch 'main' into save_step_data 2023-02-08 10:14:07 -05:00
burnettk 5b22f46ed1 remove dup 2023-02-08 09:52:40 -05:00
burnettk 11b69fee1b add users 2023-02-08 08:04:30 -05:00
jasquat b0ca9e60f3
Merge pull request #114 from sartography/frontend/use-api-subpath
frontend: use /api subpath instead of subdomain
2023-02-07 17:20:45 -05:00
jasquat 1428c1c39f allow setting configs for the frontend through env vars w/ burnettk 2023-02-07 17:17:45 -05:00
jasquat fbe2bbfb34 allow configuring gunicorn configs in boot_server_in_docker w/ burnettk 2023-02-07 15:38:29 -05:00
burnettk 998ca43808 sentences need spaces between them 2023-02-07 15:09:49 -05:00
jasquat 03b265a522 renamed development env to local_development and testing to unit_testing w/ burnettk 2023-02-07 15:02:47 -05:00
jasquat 5fb26ae97d set up qa2 to only do path based routing w/ burnettk 2023-02-07 14:30:13 -05:00
jasquat 5ae13a8d51 added backend url to qa2 configs 2023-02-07 13:46:54 -05:00
jasquat 27075c7440 added qa2 configs to use keycloak on qa1 to test different domains w/ burnettk 2023-02-07 11:30:18 -05:00
Dan Funk be34d6990f
Merge pull request #128 from sartography/feature/bug_fixes
Feature/bug fixes
2023-02-07 08:20:16 -05:00
Kevin Burnett 814e3bd527
Update tasks_controller.py 2023-02-06 16:21:55 -08:00
burnettk 9faea2c1f7 update get_token 2023-02-06 17:55:07 -05:00
jasquat 3f484c4e3c pass tenant attributes when creating a user w/ burnettk 2023-02-06 17:34:55 -05:00
jasquat 0705bf5d58 pyl w/ burnettk 2023-02-06 16:26:42 -05:00
jasquat f03d8312f4 Merge remote-tracking branch 'origin/main' into feature/tenant-specific-fields-from-openid 2023-02-06 16:24:59 -05:00
jasquat 8c94adc143 added bambooid to status users w/ burnettk 2023-02-06 16:24:48 -05:00
Jon Herron a40b023593 POC for saving some data about each step 2023-02-06 15:59:26 -05:00
jasquat c1f7735918 allow added custom attributes to users when adding to keycloak w/ burnettk 2023-02-06 15:34:55 -05:00
jbirddog c00338e951
Backend do_engine_steps performance improvements (#129)
Co-authored-by: Dan <daniel.h.funk@gmail.com>
2023-02-06 15:25:49 -05:00
jasquat cea7f746f6 use our json encoder to dump the user for get_current_user script w/ burnettk 2023-02-06 14:11:15 -05:00
Dan 54be9535f6 Use the same markdown library for displaying as for editing - could enable a security run_pyl 2023-02-06 12:20:29 -05:00
Dan 0e3ba4664f When catching non-jinja errors from Jinja, raise a good error message, and make a best effort at tracking down the line number and error line if possible. 2023-02-06 12:06:37 -05:00
burnettk 8ce5855b78 move towards returning dict in get_current_user 2023-02-06 10:30:38 -05:00
burnettk 142288537a Merge remote-tracking branch 'origin/main' into feature/tenant-specific-fields-from-openid 2023-02-06 10:20:40 -05:00
burnettk ab9614c6b4 add test users 2023-02-06 10:03:51 -05:00
Dan c7438253c7 run_pyl 2023-02-06 08:05:33 -05:00
Dan 0b3f67abae When searching for human tasks to determine if the current user can complete it, filter on the "completed" flag.
Front-end -- enable the form if you receive an onUnathorized error because the thing you are unauthorized to do might have nothing to do with whether you can submit the form.
2023-02-06 08:01:37 -05:00
Jon Herron 3b5763e8d0 Back to inserting every log 2023-02-04 12:55:48 -05:00
burnettk 84008cb6c1 hoping to fix tests on windows 2023-02-04 00:36:17 -05:00
burnettk 32007c3cbb grab bamboo_id from keycloak 2023-02-04 00:12:01 -05:00
burnettk 60ab826e1b lint 2023-02-04 00:09:43 -05:00
burnettk a9f00ce1a7 if there are tenant specific fields in the config, transfer them from openid token to db 2023-02-04 00:03:32 -05:00
Dan 1e399e05bd Merge branch 'main' of github.com:sartography/spiff-arena into main 2023-02-03 17:01:13 -05:00
Dan d010c2bce6 Fix that dreadful unknown "KeyError" exception that was cropping up.
Adding a bit of detail to the spiffworkflow exceptions when a duplicate process model is found.
Disable the submit button on tasks after you click submit (avoid the double click and give users a better experience)
2023-02-03 17:01:03 -05:00
Kevin Burnett d4f314dadf
Merge pull request #125 from sartography/feature/dynamically-hide-fields-w-task-data
Feature/dynamically hide fields w/ task data
2023-02-03 13:20:19 -08:00
burnettk 53d99c49d1 refactor some stuff in task_show to separate functions 2023-02-03 16:17:36 -05:00
burnettk 408759d122 show that hiding nested fields works as well 2023-02-03 15:47:35 -05:00
burnettk c3cb288875 make form schema and form ui schema both dicts, add support for hiding fields based on task data 2023-02-03 15:40:14 -05:00
Dan 0b9c82c68d run_pyl 2023-02-03 13:58:38 -05:00
Dan Funk dd692cf671
Merge branch 'main' into feature/more_better_errors 2023-02-03 13:21:48 -05:00
burnettk ff1ccdd600 add more users, and try to prevent sentry notification again 2023-02-03 13:11:39 -05:00
burnettk af89d38963 remove service accounts, formalize j, add madhurya 2023-02-03 13:02:50 -05:00
burnettk 548c56e358 make test_user_lists more complete and correct 2023-02-03 12:51:57 -05:00
burnettk c945304b06 clean up sentry notification and avoid logger.exception when we do not want sentry 2023-02-03 11:06:40 -05:00
burnettk 70d636ccad couple last serializer updates 2023-02-02 22:04:34 -05:00
burnettk 5735d748c2 import EventBasedGatewayConverter from correct package 2023-02-02 21:55:26 -05:00
burnettk c449d17852 try to improve exception handling by avoiding raising ApiError from services 2023-02-02 19:00:58 -05:00
burnettk 125f8eba03 simplify spiff integration post serializer update, w/ elizabeth and jon 2023-02-02 15:40:01 -05:00
Jon Herron f1068ea8c1 Quick fix for url building 2023-02-02 15:04:57 -05:00
jbirddog 18a23a729a
File download from workflow data (#122) 2023-02-02 14:44:37 -05:00
jbirddog f4ff86f9b0
Allow for different Python Environments when executing scripts within SpiffWorkflow (#121) 2023-02-02 10:24:55 -05:00
burnettk 53cf26e8ef add keycloak users 2023-02-02 09:54:19 -05:00
burnettk 974a2e3560 bulk insert logs for performance improvement 2023-02-01 17:06:34 -05:00
burnettk 808d8d4aab there is no need to ever sentry_sdk.start_transaction because the flask integration does that 2023-02-01 13:44:12 -05:00
burnettk 847a2cebf2 get some more insight into connector proxy timings 2023-02-01 13:30:45 -05:00
burnettk 7da3cb0377 avoid poetry installing deps when we have them cached if they do not change 2023-02-01 07:53:35 -05:00
burnettk cd435841d7 more spans to track performance 2023-02-01 07:45:48 -05:00
burnettk cd2ff49ea6 more sentry performance tracing 2023-01-31 22:30:15 -05:00
burnettk 7b4d714a06 folks who can start instances can also view their logs 2023-01-31 17:11:11 -05:00
burnettk 8a53c5103b shuffle around Dockerfile to allow to work for background container 2023-01-31 16:14:22 -05:00
Dan Funk acf1cce024
Merge pull request #117 from sartography/feature/authorization
move away from using the auth_token from the open id server as a token between the front end and backend.
2023-01-31 12:03:51 -05:00
burnettk 812c26ad9d allow overriding git related configs w/ env var and log permissions stuff on boot 2023-01-30 18:40:03 -05:00
Dan 358d2c320e Merge branch 'main' into feature/more_better_errors 2023-01-30 17:08:10 -05:00
Dan Funk e7b5c5ee6a
Merge pull request #115 from sartography/backend/improve-dockerfile
backend: avoid redundant steps in Dockerfile
2023-01-30 17:02:35 -05:00
Dan fcbf26d7f4 Fix typing issue. 2023-01-30 16:50:43 -05:00
Dan 4157a35f1a Use the id_token, not the auth_token from the open id server for authentication with the front end. The auth_token should be kept safe, and not guranteeded to be a json token. 2023-01-30 13:09:23 -05:00
burnettk 15b47b379c add four new status users to spiff realm 2023-01-30 11:57:22 -05:00
Jakub Sokołowski 878f61ec49
backend: avoid redundant steps in Dockerfile
Use separate `base`, `setup` and `final` to avoid redundat steps.
Avoid runnig `poetry` twice, and add `source` and `description`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-30 16:23:37 +01:00
jasquat ea994f4165 removed old pin to spiffworkflow w/ burnettk 2023-01-27 13:21:39 -05:00
jasquat 00164b1089 tests are passing now w/ burnettk 2023-01-27 13:20:22 -05:00
jasquat a882355803 some initial updates w/ burnettk 2023-01-27 12:51:19 -05:00
Jon Herron 68673b9360 Allow set to be called from scripts 2023-01-27 07:03:45 -05:00
burnettk fbf3dd788f update lock file in backend and arena, though that one needs pruning 2023-01-26 21:59:02 -05:00
Dan a68c11b6f5 run_pyl 2023-01-26 18:39:51 -05:00
Dan 761023c621 Workflow Data Exceptions were not getting processed, we now catch the WorkflowDataException through the generic top level SpiffWorkflowException. 2023-01-26 18:26:17 -05:00
jasquat 5b72be5b01 updated prefix for background instances w/ burnettk 2023-01-26 15:38:14 -05:00
Kevin Burnett ee01639427
Merge pull request #110 from sartography/feature/jinja_errors
Feature/jinja errors
2023-01-26 08:24:48 -08:00
burnettk 8a3de64239 add keycloak users 2023-01-26 09:31:01 -05:00
jasquat aa802be5af pyl 2023-01-26 07:46:36 -05:00
jasquat 1e7b80bd7d set the correct type for task since SpiffTask and a backend task are not the same 2023-01-26 07:35:13 -05:00
jasquat 1cbb661fa0 increased the task data size 2023-01-25 17:45:47 -05:00
jasquat f436edf07e added pylint back to lock file 2023-01-25 17:35:22 -05:00
jasquat 0b497161e1 Merge remote-tracking branch 'origin/main' into feature/jinja_errors 2023-01-25 17:30:55 -05:00
Dan eedc994e3e run_pyl had various recommendations that I find a bit of a pain in the butt, but that I did anyway. 2023-01-25 16:43:28 -05:00
jasquat 310133bb4d
Merge pull request #109 from sartography/feature/upgrade_bandit
upgraded bandit and flake8 w/ burnettk
2023-01-25 16:25:21 -05:00
jasquat 7dc2bcecd1 removed debug print statements 2023-01-25 16:25:03 -05:00
jasquat 0da69d1e05 ensure we are passing the primary file name to the delete file test 2023-01-25 16:20:55 -05:00
jasquat a8ec1d634e fixed typo w/ burnettk 2023-01-25 16:08:58 -05:00
jasquat 236c839748 added some debug statements for ci w/ burnettk 2023-01-25 16:02:07 -05:00
jasquat 64333e1cfc upgraded bandit and flake8 w/ burnettk 2023-01-25 15:44:53 -05:00
Dan b59cca0212 Merge remote-tracking branch 'origin/main' into feature/jinja_errors 2023-01-25 15:38:52 -05:00
jasquat d9cffcb963 allow removing users from groups when refreshing permissions w/ burnettk 2023-01-25 15:12:48 -05:00
Dan 4badc7e645 Added useMemo to error context
No longer clear errors in the task bar, as that will constantly remove them as soon as they are shown.
2023-01-25 15:09:05 -05:00
jasquat 1702521ccb Merge branch 'main' of github.com:sartography/spiff-arena 2023-01-25 14:36:05 -05:00
jasquat 4e9a517110 when changing the primary file name also change the primary process when updating a process model from the api w/ burnettk 2023-01-25 14:36:01 -05:00
Dan c4ba9f398d Making sure we create informative messages when encountering jinja2 syntax errors. 2023-01-25 14:13:21 -05:00
burnettk 4f93cd45b3 delete legacy flask-rendered html pages from initial prototype, since backend is now API-only 2023-01-25 11:30:19 -05:00
jasquat cc1fe58c47 added the process model identifier for the diagram if it is not the top level w/ burnettk 2023-01-25 10:39:17 -05:00
jasquat 63ff763807
Merge pull request #107 from sartography/feature/metadata_on_instance_show
Feature/metadata on instance show
2023-01-24 16:54:43 -05:00
jasquat b05e7fcd38 do not allow deleting primary bpmn file and do not allow instantiating models without a primary bpmn file w/ burnettk 2023-01-24 15:15:48 -05:00
jasquat 433c401073 show metadata on instance show page but for some reason it reorders elements w/ burnettk 2023-01-24 14:35:27 -05:00
jasquat 7ca6a703f2 removed uniqueness constraint from human task so we can loopback to a previous task with a gateway w/ burnettk 2023-01-24 11:03:55 -05:00
jasquat 09a502d48d ensure order of permissions in tests 2023-01-24 10:23:47 -05:00
burnettk 482de8690c document future enhancement 2023-01-23 17:48:06 -05:00
jasquat 46549486b3 strip off newlines and spaces when importing secrets and pinning spiffworkflow to working version until we can debug issues with new one w/ burnettk 2023-01-23 17:18:47 -05:00
jasquat 3f692ab1cb added locking system for process instances so hopefully background jobs will not take instances currently being run by the user w/ burnettk 2023-01-23 16:45:07 -05:00
jasquat bc8dd80d99 added uniqueness constraint to spiff step details w/ burnettk 2023-01-23 11:03:17 -05:00
burnettk 1b3fc9f55e add sum and format 2023-01-22 18:10:47 -05:00
jasquat ea8d310299 expanded functionality of the form builder 2023-01-21 20:51:11 -05:00
burnettk 5a2db8e040 Revert "allow updating models on staging for a bit"
This reverts commit 1051340ab8.
2023-01-20 20:47:00 -05:00
burnettk 7df9255e36 Revert "commit on save yes for now"
This reverts commit 39ecb70046.
2023-01-20 20:46:52 -05:00
burnettk 54f2a27864 qa1 2023-01-20 20:44:01 -05:00
burnettk b2fe7206e1 since accepting the github host entry programatically is no more secure 2023-01-20 19:06:59 -05:00
burnettk 39ecb70046 commit on save yes for now 2023-01-20 19:00:46 -05:00
burnettk 1051340ab8 allow updating models on staging for a bit 2023-01-20 18:07:29 -05:00
jasquat 46f3527835 allow getting the GIT SSH key from an app config so we can set it in the secrets file w/ burnettk 2023-01-20 15:43:00 -05:00
jasquat 9bf8bc505d allow specifying an ssh key for git instead of a username and password w/ burnettk 2023-01-20 15:11:23 -05:00
jasquat dddb42e423 updated admin user on sartography realm w/ burnettk 2023-01-20 14:09:03 -05:00
jasquat 873967f6b5 allow passing a realm name into start keycloak and added admin user to sartography realm 2023-01-20 13:21:52 -05:00
jasquat a6fbe6715d find the top level process to find the task form when using subprocesses in called activities w/ burnettk danfunk 2023-01-20 12:03:29 -05:00
jasquat c488615dcf pyl w/ burnettk 2023-01-19 15:37:55 -05:00
Kevin Burnett 6434f1bc9b
Merge branch 'main' into feature/improved_errors 2023-01-19 12:18:02 -08:00
jasquat d112a6489f ensure we have something in the logs w/ burnettk 2023-01-19 15:16:59 -05:00
jasquat a56c3d851e pyl w/ burnettk 2023-01-19 15:03:33 -05:00
jasquat edbc82fae2 added configs for sartography env w/ burnettk 2023-01-19 14:54:39 -05:00
Dan b151ef7937 pre-commit-in-ci 2023-01-19 14:00:36 -05:00
Dan 59564d561d updating spiffworkflow version, and fixing the run_pyl (by removing the corft I stuck in earlier) 2023-01-19 13:55:35 -05:00
Dan bd150dfff9 Merges 2023-01-19 13:26:13 -05:00
Dan 628c59dde9 Lots of adjustments from running pyl
Main change is in the ErrorDisplay.tsx to assure all error information is provided. and index.css to make it "pretty"
2023-01-19 12:36:45 -05:00
jasquat ac37d1355c added new test users for status in keycloak w/ burnettk 2023-01-19 12:21:25 -05:00
jasquat 1919ccfaa8 added script to add test keycloak users and moved all keycloak stuff to keycloak directory w/ burnettk 2023-01-19 12:18:05 -05:00
jasquat 73a759fcb2 pin SpiffWorkflow to passing version for CI tests w/ burnettk 2023-01-19 11:10:36 -05:00
jasquat 46c7e25494
Merge pull request #105 from sartography/feature/avoid_logs_when_call_activity_waiting
do not write to logs when a task is inheriting data from the parent w…
2023-01-19 11:08:51 -05:00
jasquat 2cd861bdd3 disabled flake8 forcing comments to avoid all of the useless comments but still enforcing the formatting of comments if they exist w/ burnettk 2023-01-19 10:41:26 -05:00
jasquat 6a6bde2788 show start events in logs as well and added bpmn process identifiers to log table w/ burnettk 2023-01-19 10:06:30 -05:00
burnettk 6dca7d3964 downgrade spiff and upgrade some other stuff 2023-01-19 07:59:26 -05:00
burnettk 8280318bc2 upgrade certifi to fix security vulnerability 2023-01-19 07:38:57 -05:00
jasquat 26de48193c do not allow overwriting process models and process groups w/ burnettk 2023-01-18 14:40:03 -05:00
jasquat cb9d36f714 added End Event to simple log view w/ burnettk 2023-01-18 12:01:37 -05:00
jasquat 3416b2f015 pyl w/ burnettk 2023-01-18 10:39:53 -05:00
jasquat 1d717cff6b skip failing xml test on windows w/ burnettk 2023-01-18 10:38:43 -05:00
jasquat baf60e9cc9 use the correct windows path separator in test file 2023-01-18 09:43:19 -05:00
jasquat e24a62b4ab favor user_input_required over waiting status for process instances w/ burnettk 2023-01-17 17:09:26 -05:00
jasquat 2c6937eb18 fixed broken test w/ burnettk 2023-01-17 16:17:04 -05:00
jasquat 2db07b5f74 only show milestones for simple log view w/ burnettk 2023-01-17 16:13:11 -05:00
jasquat 336fb1d8d2 do not resolve entities when parsing xml w/ burnettk 2023-01-17 14:58:54 -05:00
Dan 127eb7868c Removing dependency on flask-bpmn and taking it out of SpiffArena
Slightly updating the APIError code for recent updates to SpiffWorkflow's error refactoring.
2023-01-17 12:56:06 -05:00
jasquat 8fa5866f94 do not write to logs when a task is inheriting data from the parent w/ burnettk 2023-01-17 12:23:51 -05:00
jasquat 41706b3355 updated open id url for compose ci 2023-01-16 13:27:44 -05:00
jasquat a91b8c68e8 pyl 2023-01-16 13:11:25 -05:00
jasquat 4055772bde fixed cypress tests 2023-01-16 12:24:02 -05:00
burnettk c147cdb47b postgres does not have group_concat, and it is stricter about getting back columns when grouping 2023-01-15 00:22:40 -05:00
Kevin Burnett d9574acee8
Merge pull request #102 from sartography/feature/waku-fault-message
Feature/waku fault message
2023-01-13 11:47:05 -08:00
Kevin Burnett 6fc41201b1
Merge pull request #101 from sartography/task_data_len
Throw an exception if max task data length is exceeded
2023-01-13 11:43:46 -08:00
jasquat c0046d1ae5 Merge branch 'main' of github.com:sartography/spiff-arena 2023-01-13 14:41:55 -05:00
jasquat c7817b67c2 fixed broken test w/ burnettk 2023-01-13 14:41:51 -05:00
jbirddog d5d9abe239
Skip refresh steps (#103) 2023-01-13 14:32:19 -05:00
jasquat 2d61bf378e added tasks table to process instance show page w/ burnettk 2023-01-13 14:31:12 -05:00
mike cullerton 043dea0796 Merge branch 'main' into feature/waku-fault-message 2023-01-13 12:11:40 -05:00
mike cullerton 56d61806a9 run_pyl changes 2023-01-13 11:50:36 -05:00
Jon Herron 65fa9e4834 Fixed failing test 2023-01-13 11:11:12 -05:00
jasquat 189dbc2712 stop at call activity as well when getting calling subprocesses by child id w/ burnettk 2023-01-13 10:43:25 -05:00
Jon Herron 8cd275a54f Getting ./bin/pyl to pass 2023-01-13 09:45:05 -05:00
Jon Herron e370f6164d Merge branch 'main' into task_data_len 2023-01-13 09:37:32 -05:00
Jon Herron e0b1d6877b Bump the limit to 1mb 2023-01-13 09:12:41 -05:00
Jon Herron ab2d0cdf6d Better impl 2023-01-13 09:05:35 -05:00