Commit Graph

2070 Commits

Author SHA1 Message Date
jasquat 973e8fce72
added option to clone process models in boot in docker script w/ burnettk 2024-05-03 16:31:27 -04:00
jasquat e085c90114
Merge branch 'main' of github.com:sartography/spiff-arena 2024-05-03 14:57:39 -04:00
jasquat d01e52d81f
fixed run process model script to work with celery w/ burnettk 2024-05-03 14:57:35 -04:00
burnettk d7f0026433
add jq to backend deployment image 2024-05-03 13:50:42 -04:00
jasquat 84feef321d
Fix process data get subprocess (#1493)
* added test to make sure we can get the data object of a sub process

* avoid the processor altogether to get data objects but use the db directly

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-05-03 11:10:55 -04:00
jasquat 86f97d5937
New calling process table (#1480)
* added new table to handle called process relationships

* process caller api endpoint is working again w/ burnettk

* fixed more tests and mypy w/ burnettk

* unit tests are passing and commented out unrelated failing test w/ burnettk

* all tests are passing almost w/ burnettk

* uncommented flakey test w/ burnettk

* minor change while reviewing w/ burnettk

* some changes from coderabbit suggestions w/ burnettk

* commented out sampling change w/ burnettk

* name the foreign keys on the process caller table w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-05-03 10:09:32 -04:00
burnettk fa8f46d04b
ignore flask cors issue with no fix 2024-05-02 13:24:37 -04:00
jasquat f5db660878
Perms for group navigate (#1470)
* wip related to giving access to groups when you have subgroups

* handle deny permissions and check normal permissions if pg parent method as well w/ burnettk

* reverted local dev perm file w/ burnettk

* a little test cleanup

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-30 14:11:51 -04:00
Kevin Burnett 98b87cde82
make sure init params are in include list (#1467)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-29 14:42:35 -07:00
jasquat 0d7a114c98
Config turn off threads (#1466)
* added config to turn off task execution with threads w/ burnettk

* do not run tasks in parallel if they have gateway children w/ burnettk

* remove debugging code w/ burnettk

* attempting to fix flakey test w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-29 16:50:20 -04:00
Kevin Burnett 48200283b5
bump spiff for feature/receive-message-correlations (#1454)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-29 13:04:33 -07:00
Kevin Burnett 23e147793a
make permissions on process group show more nuanced (#1460)
* if you have access to things in a group, allow navigating through group

* lint

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-29 13:03:46 -07:00
jasquat bd51222efe
allow specifying certain jwt options as configs w/ burnettk (#1459)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-26 14:36:36 -07:00
jasquat 00c2e85fee
Data store background fix (#1455)
* added test to demonstrate data store issue when run in certain contexts w/ burnettk

* added method to add kkv data store getters back onto tasks if appropriate w/ burnettk

* removed debug code w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-26 10:14:26 -04:00
jasquat c6f0dd65e5
log original error when token decoding fails w/ burnettk 2024-04-25 12:19:45 -04:00
jasquat d76333065a
remove useless comment w/ burnettk 2024-04-24 15:51:53 -04:00
jasquat 1355c97b69
load-parent-task-data (#1447)
* load task data for the immediate completed parent and for cancelled tasks

* reverted query_tasks script

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-04-24 14:08:31 -04:00
burnettk c2856be3bf
remove flake8 because ruff and bandit because it is in backend, fix long line 2024-04-24 12:59:20 -04:00
burnettk d197bf00a2
couple fixes to get current user finder script 2024-04-24 12:57:11 -04:00
jasquat ced3bffd69
pass task data from the db if data cannot be found on the expected task on the interstitial page (#1440)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-23 14:04:04 -07:00
burnettk 647133340d
bump spiff for message fix 2024-04-19 12:54:34 -04:00
burnettk e198c8c866
update spiff for #1415 fix, and update expectation for now-started subprocesses 2024-04-18 17:15:18 -04:00
jasquat 32141a238e
Reset task in call activity fix (#1417)
* updated import pi test to set task data w/ burnettk

* fixed persist test so it loads the processor with data

* load data and completed tasks when getting bpmn json for an instance

* save start and end times on tasks on import w/ burnettk

* verify we are saving start and end times for imported process instances w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-18 14:11:53 -04:00
jasquat 6643db9f2f
Pi file data on fs (#1403)
* added basic support to store process instance file data on the file system w/ burnettk

* the files need to be in a hashed directory structure w/ burnettk

* fixed exception message w/ burnettk

* use the same entry method to the contents of data file w/ burnettk

* fixed hash method w/ burnettk

* make hash method easier to read w/ burnettk

* added a migrator and test for migration w/ burnettk

* fix a couple things while testing

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-18 11:24:59 -04:00
jasquat a99c36964d
mi-task-show-fix (#1412)
* check for mi tasks first before checking more newest in task show api w/ burnettk

* remove console

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-17 11:53:10 -07:00
jbirddog 823bdd170b
Allow updating task data via a dictionary (#1414)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-04-17 14:20:51 -04:00
jasquat 94a60827e1
updated SpiffWorkflow to deepcopy task data (#1408)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-17 09:38:03 -04:00
dependabot[bot] 9891732515
Bump black from 24.3.0 to 24.4.0 (#1404)
* Bump black from 24.3.0 to 24.4.0

Bumps [black](https://github.com/psf/black) from 24.3.0 to 24.4.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/24.3.0...24.4.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* update black in backend as well for safety

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-16 10:57:15 -04:00
jasquat dc44cb28d5
fixed and ignored unfixable synk issues 2024-04-16 10:22:57 -04:00
jasquat 9147a8db8c
Use vite to build (#1390)
* some base updates for vite w/ burnettk

* i can log in w/ burnettk

* a couple more fixes w/ burnettk

* make sure selectedTabIndex has been set before using it w/ burnettk

* fixed active-users db issue, added type module to package json to fix prerender issues, and various other issues w/ burnettk

* fixed issues with building and running from compiled w/ burnettk

* pyl

* eslint fix is running and removed both inferno and navigationBar warnings

* vim likes the Dockerfile suffix by default

* use process.env.HOME

* probably do not need alias

* a little clean up and fixed font warnings w/ burnettk

* updated elements to remove warnings in the console w/ burnettk

* fixed es lint issues w/ burnettk

* update docker build in frontend w/ burnettk

* set the specific tag of nginx w/ burnettk

* build docker imgaes for this branch to test w/ burnettk

* added vitest and updated Dockerfile to be nginx w/ burnettk

* tests are passing w/ burnettk

* add prefresh and more keys

* added cypress-vite to attempt to get cypress working again

* some coderabbit suggestions

* hopefully there is no reason to use PUBLIC_URL at all when using vite

* use the correct location of the index file in the docker image

* spaces are fine in index.html file variable declaration

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-15 14:22:34 -04:00
jasquat dff34c7bfc
removed instruction from end event on new process model bpmn template 2024-04-15 10:23:10 -04:00
Kevin Burnett c091ae9f9e
bump spiff for PR 402, ensure parser knows about all namespaces (#1376)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-10 10:42:36 -07:00
Kevin Burnett f2c982a96c
Look for bad get_current_user scripts (#1370)
* initial script to find get_current_user calls

* handle pre and post scripts as well

* refactor

* omit absolute root dir path when printing

* avoid printing NS

* consolidate lxml parsing in one place

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-10 09:44:13 -07:00
jbirddog 9043a08a9e
Drop element units as a dependecy (#1366) 2024-04-10 11:22:52 -04:00
jasquat 293aa867a1
Auth for secrets (#1369)
* added new api to show secrets so we can use that in permissions

* updated frontend to use new secret show value api

* cleaned up secret_show method

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-09 13:44:47 -04:00
Kevin Burnett cce555b2ca
ignore venv, and ensure always sort group members to fix flaky test in postgres (#1357)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-08 11:26:07 -07:00
Kevin Burnett 2b6640f24c
Prevent duplicated path prefix elements in generated URLs take two (#1350)
* Prevent duplicated path prefix elements in generated URLs

* add more debug info

* pure refactor

* let flask determine how to access site

* build this branch

* build image

* use more url_for, which includes a slash, and things are working locally

* fix hopefully the last missing url_for

* add some code that works for any openid provider

* one more url_for and remove more backend url config references

---------

Co-authored-by: Bret Mogilefsky <bmogilefsky@gmail.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-04-08 08:50:55 -07:00
jasquat f6943cf059
load all task data when attempting to get the next task instruction w/ burnettk (#1355)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-08 07:40:52 -07:00
jasquat 01c749aa0b
Allow setting path prefix (#1344)
* allow setting the path prefix of the server w/ burnettk

* added error in case someone was successfully using SPIFFWORKFLOW_BACKEND_APPLICATION_ROOT w/ burnettk

* Update docs/DevOps_installation_integration/path_based_routing.md

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-04-05 15:14:09 -04:00
dependabot[bot] 4ec824523d
Bump mypy from 1.8.0 to 1.9.0 in /spiffworkflow-backend (#1339)
Bumps [mypy](https://github.com/python/mypy) from 1.8.0 to 1.9.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.8.0...1.9.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-05 14:32:40 +00:00
jasquat 7ae81f47cf
Celery start timer fix (#1337)
* check if pi is enqueued to run in the future before running it in celery w/ burnettk

* only mark future tasks as complete if the corresponding task is complete w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-04 16:24:58 -04:00
dependabot[bot] 6789992a76
Bump typeguard from 4.1.5 to 4.2.1 in /spiffworkflow-backend (#1336)
Bumps [typeguard](https://github.com/agronholm/typeguard) from 4.1.5 to 4.2.1.
- [Release notes](https://github.com/agronholm/typeguard/releases)
- [Changelog](https://github.com/agronholm/typeguard/blob/master/docs/versionhistory.rst)
- [Commits](https://github.com/agronholm/typeguard/compare/4.1.5...4.2.1)

---
updated-dependencies:
- dependency-name: typeguard
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-04 15:21:05 +00:00
jasquat 927f150d4f
use backend url in local openid login page w/ burnettk 2024-04-03 16:52:25 -04:00
jasquat 12e7cecd97
local-openid-path-based-fix (#1332)
* use the backend url config for the well-known endpoint since request.host_url will not know about the path w/ burnettk

* attempting to fix run precommit in ci w/ burnettk

* fix constraints location w/ burnettk

* fix correct stanza w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-03 16:16:22 -04:00
dependabot[bot] f27455eeda
Bump prometheus-flask-exporter in /spiffworkflow-backend (#1324)
Bumps [prometheus-flask-exporter](https://github.com/rycus86/prometheus_flask_exporter) from 0.22.4 to 0.23.0.
- [Commits](https://github.com/rycus86/prometheus_flask_exporter/compare/0.22.4...0.23.0)

---
updated-dependencies:
- dependency-name: prometheus-flask-exporter
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-04-03 11:14:42 -07:00
jasquat b35ab336f5
Omit completed subprocesses (#1327)
* updates to avoid loading completed subprocesses when loading a processor w/ burnettk

* bpmn unit test generator in controller test is passing w/ burnettk

* most tests are passing again w/ burnettk

* tests are all passing now w/ burnettk

* added assertion to reset pi test to ensure task data does come back w/ burnettk

* removed debug benchmark stuff w/ burnettk

* pyl w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-03 12:17:14 -04:00
Kevin Burnett d7bd03bb69
simplify build with pip and poetry in one step and no pipx (#1323)
* simplify build with pip and poetry in one step and no pipx

* upgrade setuptools

* just in case

* debug w/ burnettk

* print pwd and ls whenever we call constraints w/ burnettk

* update safety and setuptools to fix ci errors w/ burnettk

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-03 11:40:50 -04:00
jasquat 280240ca87
lookup 1000 groups when attempting to cache them so we are not restricted to 100 w/ burnettk (#1331)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-03 08:22:07 -07:00
jasquat b21a3b3ec7
Celery docs and debug (#1328)
* added script to import process instance and updated some docs for redis and celery w/ burnettk

* pyl and removed bad gitignore w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-02 16:13:18 -04:00
jasquat cef93033e8
do not store pi events when running migrations (#1310)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-04-01 12:24:02 -04:00