Commit Graph

264 Commits

Author SHA1 Message Date
jasquat 425cf3f8c1 skip failing test if postgres and added comment about cause w/ burnettk 2023-02-24 14:57:17 -05:00
jasquat 7a1e712c14 avoid using task-data endpoint for task data and only use it to get tasks based on spiff step instead 2023-02-24 09:21:21 -05:00
jasquat a4c1eb96b5 removed task-data endpoints since we no longer need them w/ burnettk 2023-02-23 17:07:53 -05:00
Dan 0030a46938 run_pyl 2023-02-23 14:17:22 -05:00
Dan 0f3ef00d72 BPMN.io -- Just show the message names not the ids - to assure we are only exposing the names.
SpiffWorkflow -
    - start_messages function should return message names, not ids.
    - don't catch external thrown messages within the same workflow process
    - add an expected value to the Correlation Property Model so we can use this well defined class as an external communication tool (rather than building an arbitrary dictionary)
    - Added a "get_awaiting_correlations" to an event, so we can get a list of the correlation properties related to the workflows currently defined correlation values.
    - workflows.waiting_events() function now returns the above awaiting correlations as the value on returned message events
 Backend
    - Dropping MessageModel and MessageCorrelationProperties - at least for now.  We don't need them to send / receive messages though we may eventually want to track the messages and correlations defined across the system - these things (which are ever changing) should not be directly connected to the Messages which may be in flux - and the cross relationships between the tables could cause unexpected and unceissary errors.  Commented out the caching logic so we can turn this back on later.
    - Slight improvement to API Errors
    - MessageInstances are no longer in a many-to-many relationship with Correlations - Each message instance has a unique set of message correlations specific to the instance.
    - Message Instances have users, and can be linked through a "counterpart_id" so you can see what send is connected to what recieve.
    - Message Correlations are connected to  recieving message instances.  It is not to a process instance, and not to a message model.  They now include the expected value and retrieval expression required to validate an incoming message.
    - A process instance is not connected to message correlations.
    - Message Instances are not always tied to a process instance (for example, a Send Message from an API)
    - API calls to create a message use the same logic as all other message catching code.
    - Make use of the new waiting_events() method to check for any new recieve messages in the workflow (much easier than
    churning through all of the tasks)
    - One giant mother of a migration.
2023-02-23 13:53:03 -05:00
Dan 790483a421 run_pyl 2023-02-20 12:34:42 -05:00
Dan 5f6a61c93f * SpiffWorkflow event_definitions wanted to return a message event's correlation properties mested within correlation keys. But messages are directly related to properties, not to keys - and it forced a number of conversions that made for tricky code. So Messages now contain a dictionary of correlation properties only.
* SpiffWorkflow did not serialize correlations - so they were lost between save and retrieve.

* When comparing Correlation Property values - we are storing these values as strings in the database and can't convert them back to integers later, so I'm changing everying everywhere to compare after conversion to a string.  Don't feel great about this one.
* By using an SQL Alchemy join table, there is a lot of db queries we don't need to write.
* A few handy fucntions on db models to make it easier to work with correlations.
* Updated tests because I changed some of the BPMN models we were testing against.
* Database migration to use the new constraint names with the alternate form of the join table between correlation mesages to instance messages.
2023-02-20 11:50:35 -05:00
Jon Herron 491d30b9b3 The End Event has a spiff step 2023-02-13 14:13:34 -05:00
Dan 18c481e3d4 run_pyl 2023-02-08 17:10:57 -05:00
Dan eb39b61488 remove the "current_user" from being added to the task_data. 2023-02-08 15:53:14 -05:00
burnettk 11a9e740af show that hiding nested fields works as well 2023-02-03 15:47:35 -05:00
burnettk 1247189bf8 make form schema and form ui schema both dicts, add support for hiding fields based on task data 2023-02-03 15:40:14 -05:00
jasquat 9e3640b169 set the correct type for task since SpiffTask and a backend task are not the same 2023-01-26 07:35:13 -05:00
jasquat 13b442f7f8 Merge remote-tracking branch 'origin/main' into feature/jinja_errors 2023-01-25 17:30:55 -05:00
Dan b2fb0dd79f run_pyl had various recommendations that I find a bit of a pain in the butt, but that I did anyway. 2023-01-25 16:43:28 -05:00
jasquat ddb55a0ce1 ensure we are passing the primary file name to the delete file test 2023-01-25 16:20:55 -05:00
Dan a38ecc2e60 Merge remote-tracking branch 'origin/main' into feature/jinja_errors 2023-01-25 15:38:52 -05:00
Dan d63f0c2a91 Making sure we create informative messages when encountering jinja2 syntax errors. 2023-01-25 14:13:21 -05:00
jasquat d86c083dfe do not allow deleting primary bpmn file and do not allow instantiating models without a primary bpmn file w/ burnettk 2023-01-24 15:15:48 -05:00
jasquat c5aff424b6 pyl w/ burnettk 2023-01-19 15:37:55 -05:00
Dan 8496b722fd Merges 2023-01-19 13:26:13 -05:00
Dan 3c12e8ad35 Lots of adjustments from running pyl
Main change is in the ErrorDisplay.tsx to assure all error information is provided. and index.css to make it "pretty"
2023-01-19 12:36:45 -05:00
jasquat d6edbe896a fixed broken test w/ burnettk 2023-01-17 16:17:04 -05:00
Dan 28a28e353b Removing dependency on flask-bpmn and taking it out of SpiffArena
Slightly updating the APIError code for recent updates to SpiffWorkflow's error refactoring.
2023-01-17 12:56:06 -05:00
mike cullerton d17f3b96d0 Merge branch 'main' into feature/waku-fault-message 2023-01-13 08:29:42 -05:00
jasquat 6474f74f78 fixed failing test w/ burnettk 2023-01-12 15:35:05 -05:00
jasquat 781c9814c2 added detailed area to process instance show page w/ burnettk 2023-01-12 15:27:32 -05:00
mike cullerton 36ee3b9551 Merge branch 'main' into feature/waku-fault-message 2023-01-12 07:19:06 -05:00
mike cullerton 95141a6832 mypy 2023-01-11 17:46:39 -05:00
mike cullerton 505964c880 Removed test for email error handler.
Added stub for testing system handler process
2023-01-10 16:33:51 -05:00
jasquat a24fca0e30 some updates to validate xml when uploading and saving w/ burnettk 2023-01-10 12:16:24 -05:00
jasquat 0bf232d92b do not allow sending messages to terminated and suspended process instances w/ burnettk 2023-01-06 16:21:29 -05:00
jasquat 7f21328b7f actually filter by process initiator w/ burnettk 2023-01-06 15:50:47 -05:00
jasquat 572ec6d397 pyl w/ burnettk 2023-01-05 17:33:18 -05:00
jasquat fbdeddab4d fixed test w/ burnettk 2023-01-05 17:31:31 -05:00
jasquat 618bbeb18a added fix to SpiffWorkflow to deepcopy operation params before evaluating them w/ burnettk 2023-01-05 17:29:28 -05:00
jasquat 499a9562c3 basic support to find a process instance by id w/ burnettk 2023-01-05 14:59:59 -05:00
jasquat 6648bee586 pyl 2023-01-04 16:15:15 -05:00
jasquat ee650e6039 added ability to filter process instances by process initiator 2023-01-04 16:11:52 -05:00
jasquat 59842a301c pyl w/ burnettk 2023-01-03 17:29:55 -05:00
jasquat 2c4ae424a4 added new page to create process models using english text w/ burnettk 2023-01-03 17:26:01 -05:00
jasquat df462e0dd0 added method to create process models based on english string w/ burnettk 2023-01-03 16:39:32 -05:00
burnettk 09e012674a upgrade black, give it the preview flag, and let it rip on long strings 2022-12-30 23:08:00 -05:00
burnettk 3c395ca368 configure metadata extration paths appropriately 2022-12-30 22:49:35 -05:00
burnettk 56b469e92e actually create process model 2022-12-30 19:51:17 -05:00
jasquat cfaf2d9c6d added basis of api to create process models from text w/ burnettk 2022-12-30 16:30:52 -05:00
burnettk d1e911950d Merge remote-tracking branch 'origin/main' into feature/process_api_blueprint_refactor 2022-12-29 20:41:50 -05:00
Elizabeth Esswein 9ae1de7627 fix test 2022-12-29 17:51:43 -05:00
Elizabeth Esswein f24d751450 Merge branch 'main' into feature/process-navigation 2022-12-29 12:09:47 -05:00
jbirddog 0aaf503c3f Make list available to script tasks (#86) 2022-12-28 17:04:47 -05:00
jasquat 08050b038a save the process instance even if it fails to run all the way w/ burnettk 2022-12-28 14:37:04 -05:00
jasquat 866346f47b added ability to view data objects from the process instance show page w/ burnettk 2022-12-27 11:45:42 -05:00
jasquat 92258c6f9a pyl w/ burnettk 2022-12-20 15:47:30 -05:00
jasquat 5a6e181a99 merged in main and resolved conflicts w/ burnettk 2022-12-20 15:06:34 -05:00
jasquat fd60c3566c renamed test process instance create method w/ burnettk 2022-12-20 11:19:04 -05:00
Elizabeth Esswein 54d6804421 fix conflicts for like the thousandth time 2022-12-20 10:41:45 -05:00
jasquat 2a73e23b3c renamed active task to human task since we are no longer deleting them w/ burnettk 2022-12-19 16:23:02 -05:00
Elizabeth Esswein 4390e90a2b fix conflicts yet again 2022-12-19 15:28:44 -05:00
Elizabeth Esswein 36924b8410 fix typing problem 2022-12-19 14:01:52 -05:00
jasquat f152195335 updates to disallow modifying a process instance when it is not in the correct state w/ burnettk 2022-12-19 12:55:25 -05:00
Elizabeth Esswein 8b863c1a1e add integration tests for process nav endpoints 2022-12-19 11:33:48 -05:00
Dan 75bd973ae0 Merge remote-tracking branch 'origin/main' into feature/bpmn_user_permissions 2022-12-16 15:25:10 -05:00
jasquat debde51b00 fix broken unit tests in backend 2022-12-15 14:57:07 -05:00
Dan 6de91d2230 Merge remote-tracking branch 'origin/unit_test_404' into feature/bpmn_user_permissions 2022-12-15 07:19:19 -05:00
Dan bcfbd9a6ea Assure our open-id system can return emails.
Update our data from Open ID Systems when users log in
2022-12-13 08:14:44 -05:00
Dan 4a8b07e98d Removing two fields from user table that were not used (uid, name)
Request email from open id clients, as this would provide a handy way to uniquely reference users when assigning to groups.
During Login do a lookup on email if possible -- so that permissions assignments based on email can be connected when sigining in through openid.
Don't use "open_id" for the service name on user accounts, use the iss string provided through open id,  this will allow us to support more than one open id platform.
Update the KeyCloak configuration so it is able to return email addresses for users -- which will make permission assignment easier in the future.
Removed several unused commands in the user_service class.
2022-12-12 15:43:19 -05:00
jasquat f6462d83af pyl 2022-12-12 15:36:03 -05:00
jasquat 52d61fabad added test to get the diagram for a given process instance call activity 2022-12-12 15:33:31 -05:00
burnettk a8ac81e4f2 comment out test not working in CI 2022-12-10 23:35:56 -05:00
burnettk c797cc28f7 indicate main explicitly for ci 2022-12-10 22:50:52 -05:00
jasquat cb143d3201 added secret verification to webhook endpoint w/ burnettk 2022-12-09 16:51:00 -05:00
jasquat 74bfd22ff9 fixed broken test w/ burnettk 2022-12-09 15:19:43 -05:00
jasquat 4878d2329b mypy w/ burnettk cullerton 2022-12-08 17:12:19 -05:00
jasquat d50d95a49c added git creds for pushing on publish w/ burnettk cullerton 2022-12-08 16:39:23 -05:00
jasquat b54378a9fc merged in main and resolved conflicts w/ burnettk cullerton 2022-12-08 15:31:25 -05:00
jasquat cee726e8b0 pyl passes 2022-12-08 13:47:30 -05:00
jasquat 675c776a5a added new notification component that allows links based on carbons w/ burnettk cullerton 2022-12-08 12:28:23 -05:00
Dan bab489fa7b Merge branch 'main' into feature/create_containers 2022-12-06 18:06:09 -05:00
mike cullerton 8b5e5dc864 Merge branch 'main' into feature/git-integration
# Conflicts:
#	spiffworkflow-backend/tests/spiffworkflow_backend/integration/test_process_api.py
2022-12-06 16:27:36 -05:00
mike cullerton 8b95b96595 Merging this unfinished test so I don't lose it.
It doesn't test anything yet.
Need to deal w/ a bunch of mock stuff
2022-12-06 16:14:46 -05:00
jasquat bc7c5920b2 cleaned up more api routes for permissions w/ burnettk 2022-12-05 16:06:08 -05:00
jasquat 55afc22148 pyl w/ burnettk 2022-12-05 14:10:07 -05:00
Dan 3a09b45765 running py_pl -- mainly reordering imports. 2022-12-05 12:29:19 -05:00
jasquat 424eb2412e added support to order reports by given column and metadata headers w/ burnettk 2022-12-05 10:59:27 -05:00
Dan 1e86345a33 Fixes based off KB's super kind review.
-------
* Remove unnecessary packages from dockerfile for the demo-connect proxy.
* Rename an environment variable that mentioned Status.im in what is now a generic connector.
* Fixed a spelling mistake.
2022-12-05 10:46:26 -05:00
burnettk 391134ad33 remove dup test process model 2022-12-04 14:40:34 -05:00
burnettk 32c709d34d lint 2022-12-03 11:24:21 -05:00
burnettk b0e68b0385 add extraction, needs test 2022-12-02 17:15:22 -05:00
burnettk 1b3bf52be3 fix tests 2022-12-02 16:53:01 -05:00
jasquat bfb2c5627a using an array for metadata extraction paths now instead of dictionaries w/ burnettk 2022-12-02 16:03:43 -05:00
jasquat 6b75fc32a3 added some support to add process model metadata. need to fix frontend w/ burnettk 2022-12-02 15:46:05 -05:00
Dan 8a61a0e17e I can't say I love flake8.
Removing dependency on rust (monkeytype)
2022-12-01 16:23:03 -05:00
Dan 48be27d367 fixing some typing issues, white space, etal... 2022-12-01 15:01:25 -05:00
Dan f01cd57d24 Reorder config imports so that instance config is dead last - and can override everything else.
Updated docker-compose for running a demo.
run_pyl fixes
2022-12-01 14:13:22 -05:00
Dan e8cbe1df84 A little cleanup of the ui
Don't check authorization on static assets
Do not require unique username on user table (uniqueness check is on the service and service id composite.)
2022-12-01 12:12:37 -05:00
jasquat abffccedbd added correlations to message list table w/ burnettk 2022-11-30 15:08:04 -05:00
Dan 3ade3e5b99 Adding a blueprint for openid - a very lightweight embedded authentication system to make it eaiser to try out SpiffWorkflow when you don't have openID set up with Google etal.
Removing all calls to open id's user_info endpoint - as these are unncessiary.
Adding a users section to the permission files -- so we can handle all user/group/permissions in one file when needed.
There was a very confusing is_admin function on the user model that needed killin.
2022-11-30 11:32:55 -05:00
jasquat 2fc44907e8 added api to get list of process report columns 2022-11-29 17:32:29 -05:00
jasquat 45eafc6060 some cleanup for metadata w/ burnettk 2022-11-29 16:19:55 -05:00
jasquat 4617974636 metadat reports work w/ burnettk 2022-11-29 16:09:55 -05:00
jasquat e5f04d10a9 WIP more metadata reporting w/ burnettk 2022-11-29 15:59:46 -05:00
jasquat ddadefee60 some basics to add metadata to reports w/ burnettk cullerton 2022-11-28 17:03:00 -05:00
burnettk fa92943317 lint 2022-11-25 00:46:43 -05:00
burnettk 1711837e88 tests passing 2022-11-25 00:08:38 -05:00
burnettk 5b73c4ddb0 gotta fix usage of is_model 2022-11-24 16:28:10 -05:00
burnettk b761a36d62 oh my god why were these ever instance methods 2022-11-24 12:38:41 -05:00
burnettk 2eb3ef6aa3 renames 2022-11-24 12:00:26 -05:00
burnettk bfae6ac63d start adding display name and removing garbage 2022-11-24 11:51:31 -05:00
jasquat c150ec97a6 updated breadcrumb to use display name w/ burnettk 2022-11-23 15:39:10 -05:00
jasquat e5e6226bb9 created new users for keycloak and fixed some permissions for core user w/ burnettk cullerton 2022-11-22 13:01:08 -05:00
jasquat 50c137101b added recursive option to process model list to recurse or not and fix some ui components 2022-11-22 09:05:33 -05:00
mike cullerton e36bf1b548 Merge branch 'main' into move-group-or-model 2022-11-21 15:56:44 -05:00
jasquat 92d77f3a51 allow getting all process models, process instances should not save when they are initialized, and fixed some cypress tests w/ burnettk 2022-11-21 14:12:04 -05:00
mike cullerton f0103fb29d use correct separator. 2022-11-21 12:05:25 -05:00
mike cullerton 168ce9cff3 see if this solves the windows build problem 2022-11-21 08:36:39 -05:00
mike cullerton dc13c1c1ca asst syntax cleanup 2022-11-19 15:45:13 -05:00
mike cullerton fd93d558e2 mypy 2022-11-19 15:24:37 -05:00
mike cullerton 5a1bd19e99 test for move model 2022-11-19 14:47:50 -05:00
mike cullerton 618464aeed process group move api endpoint 2022-11-19 13:24:40 -05:00
jasquat 77ff18a85c pyl is passing w/ burnettk cullerton 2022-11-18 16:45:44 -05:00
mike cullerton 576d60e41d precommit 2022-11-18 15:50:20 -05:00
mike cullerton f88f576dcb Rename CAT_JSON_FILE, WF_JSON_FILE, add_spec, update_spec 2022-11-17 12:08:42 -05:00
jasquat d93a1c910f added some permissions to the process model show page w/ burnettk 2022-11-15 17:35:16 -05:00
burnettk b63693514a fix mypy typing stuff. w/ jasquat 2022-11-15 10:28:18 -05:00
burnettk d748f019e8 run_pyl 2022-11-15 10:11:26 -05:00
Dan a9df1ed23f Merge remote-tracking branch 'origin/main' into feature/call_activity_selection 2022-11-15 09:55:02 -05:00
Dan 22d1186236 Adding a very simple api endpoint that just returns a list of every process known to the system. 2022-11-14 21:54:13 -05:00
Dan 88a40c73ea Assure that the list of cached Spec References includes all Process Instances and DMNs (even those that are not primary) 2022-11-14 20:31:20 -05:00
jasquat 9ed04d63fa merged in main and resolved pyl issues w/ burnettk 2022-11-14 12:24:23 -05:00
Dan ce98cd75de work in spiff is approved and merged, updating dependency 2022-11-14 10:40:52 -05:00
burnettk fd2470965d lint and mypy 2022-11-12 22:07:30 -05:00
Dan 0d0235ec70 Adding a display name to the BPMN Process ID Lookup Table
Removing (very nearly, except for script unit tests) all the XML Parsing we were doing, see related PR on SpiffWorkflow
Moved the Custom Parser into its own file to solve some circular import issues
2022-11-12 12:36:07 -05:00
burnettk 91b69e0ada pyl 2022-11-11 11:39:15 -05:00
mike cullerton f116aed598 renamed and reordered some methods in base_test.py 2022-11-11 08:02:35 -05:00
mike cullerton 2e7a605149 Merge branch 'main' into feature/nested-groups-2
# Conflicts:
#	spiffworkflow-frontend/src/routes/ProcessGroupShow.tsx
2022-11-10 16:50:11 -05:00
mike cullerton b13bfe0489 Delete groups now checks for running instances in nested models
also, pyl
2022-11-10 16:44:27 -05:00
jasquat 8ae9179a64 use error as a status instead of faulted w/ burnettk 2022-11-10 15:55:17 -05:00
jbirddog 5b01c50d6a Move to Python 3.11 (#27) 2022-11-09 13:45:16 -05:00
mike cullerton b646fa98bd Merge branch 'main' into feature/nested-groups
# Conflicts:
#	spiffworkflow-backend/src/spiffworkflow_backend/api.yml
#	spiffworkflow-backend/src/spiffworkflow_backend/models/process_instance_report.py
#	spiffworkflow-backend/src/spiffworkflow_backend/routes/process_api_blueprint.py
#	spiffworkflow-backend/tests/spiffworkflow_backend/integration/test_process_api.py
#	spiffworkflow-backend/tests/spiffworkflow_backend/unit/test_spec_file_service.py
#	spiffworkflow-frontend/src/routes/ProcessInstanceList.tsx
#	spiffworkflow-frontend/src/routes/ProcessInstanceReportList.tsx
#	spiffworkflow-frontend/src/routes/ProcessModelEditDiagram.tsx
#	spiffworkflow-frontend/src/routes/ProcessModelShow.tsx
2022-11-08 14:09:03 -05:00
jasquat 9d4e096a5d return next task when running an instance w/ burnettk 2022-11-08 12:36:11 -05:00
jbirddog 8b47cf49fb First pass at custom report/perspective for Process Instance List (#23) 2022-11-08 09:26:42 -05:00
mike cullerton 43069236d1 remove process_group_identifier from process-instances endpoint 2022-11-07 17:25:04 -05:00
mike cullerton 19bbc0da92 Merge branch 'main' into feature/nested-groups
# Conflicts:
#	spiffworkflow-backend/src/spiffworkflow_backend/models/process_model.py
#	spiffworkflow-backend/src/spiffworkflow_backend/services/process_instance_processor.py
#	spiffworkflow-backend/tests/spiffworkflow_backend/integration/test_process_api.py
2022-11-07 10:56:37 -05:00
mike cullerton 9d6d6cf2af started test for test_script_unit_test_run 2022-11-07 10:34:14 -05:00
mike cullerton d6ad90ac15 Fix url in test 2022-11-06 15:09:56 -05:00
mike cullerton 0dad6788ff Fix urls for uspend and resume endpoints 2022-11-06 14:23:16 -05:00
burnettk 921fc04d29 Merge remote-tracking branch 'origin/main' into feature/carbon_ui 2022-11-04 18:33:07 -04:00
jasquat 57cc5f732b pyl is passing w/ burnettk 2022-11-04 11:03:40 -04:00
burnettk 061953b806 Merge commit 'a0b923c9ad98d07d3cf46dca689a01b13d41aa02' 2022-11-04 09:33:44 -04:00
jasquat 7fffa650b0 some more updates for group forms w/ burnettk 2022-11-03 15:55:50 -04:00