Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Malcolm v23.12.0 #290

Merged
merged 84 commits into from
Dec 5, 2023
Merged

Malcolm v23.12.0 #290

merged 84 commits into from
Dec 5, 2023

Commits on Oct 26, 2023

  1. bump for v23.11.0 development

    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    fa17a78 View commit details
    Browse the repository at this point in the history

  2. add option to auto-create catch-all netbox IPAM prefixes for private … 

    …IP space (idaholab#279)
    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    308a1b0 View commit details
    Browse the repository at this point in the history

  3. add option to auto-create catch-all netbox IPAM prefixes for private … 

    …IP space (idaholab#279)
    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    e20983c View commit details
    Browse the repository at this point in the history

  4. reduce verbosity of netbox

    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    edd49a1 View commit details
    Browse the repository at this point in the history

  5. add option to auto-create catch-all netbox IPAM prefixes for private … 

    …IP space (idaholab#279)
    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    94e8f76 View commit details
    Browse the repository at this point in the history

  6. address issues with NetBox database and Logstash's NetBox cache (idah… 

    …olab#259); work in progress, almost certainly broken in this state
    @mmguero
    mmguero committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    cab66bd View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. work in pgoress for address issues with NetBox database and Logstash'… 

    …s NetBox cache (idaholab#259)
    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    8831476 View commit details
    Browse the repository at this point in the history

  2. work in pgoress for address issues with NetBox database and Logstash'… 

    …s NetBox cache, should fix locking issues (idaholab#259)
    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    20a89d5 View commit details
    Browse the repository at this point in the history

  3. specify lru_redux in the gemspec

    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    16d5053 View commit details
    Browse the repository at this point in the history

  4. address issues with NetBox database and Logstash's NetBox cache (idah… 

    …olab#259); restore caching for performance reasons, but decrease TTL significantly and allow it to be specified via environment variable
    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    92b4b34 View commit details
    Browse the repository at this point in the history

  5. bump Werkzeug to v3.0.1 as patch for DoS 'High resource usage when pa… 

    …rsing multipart/form-data containing a large part with CR/LF character at the beginning'
    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    12b4f57 View commit details
    Browse the repository at this point in the history

  6. allow specifying capture parameters when orchmode is kubernetes

    @mmguero
    mmguero committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    86a41d0 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Update Zeek to v6.1.0

    @mmguero
    mmguero committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    b4f8d44 View commit details
    Browse the repository at this point in the history

  2. point downstream to mmguero-dev/icsnpp-modbus until cisagov/icsnpp-mo… 

    …dbus#8 is pulled
    @mmguero
    mmguero committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    ed99af5 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. Working on zeek v6.1.0 build

    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    da45848 View commit details
    Browse the repository at this point in the history

  2. update some of the documentation for docker compose (v2) as a plugin … 

    …rather than a standalone script
    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    70c7773 View commit details
    Browse the repository at this point in the history

  3. update some of the documentation for docker compose (v2) as a plugin … 

    …rather than a standalone script
    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    c9742bb View commit details
    Browse the repository at this point in the history

  4. fix zeek build

    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    be6a9df View commit details
    Browse the repository at this point in the history

  5. use spicy disable protocol analyzer for LDAP

    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    3aa72fc View commit details
    Browse the repository at this point in the history

  6. point back upstream for a few of the plugins

    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    30a05d9 View commit details
    Browse the repository at this point in the history

  7. use prefix.description instead of VRF for identifying subnets in NetB… 

    …ox (idaholab#280); needs testing
    @mmguero
    mmguero committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    2a804c6 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. use docker compose as a plugin rather than docker-compose when possible

    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    69ce77c View commit details
    Browse the repository at this point in the history

  2. fix issue with logs

    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    4be0d17 View commit details
    Browse the repository at this point in the history

  3. fix issue parsing dns.ip

    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    fd69cad View commit details
    Browse the repository at this point in the history

  4. make sure preloaded prefixes get populated with default site name (id… 

    …aholab#279)
    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    e518880 View commit details
    Browse the repository at this point in the history

  5. fix start not stopping log display

    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    c2f043e View commit details
    Browse the repository at this point in the history

  6. fix issue with prefix name not being used for segments correctly (ida… 

    …holab#280)
    @mmguero
    mmguero committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    570fce9 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. update logstash (https://www.elastic.co/guide/en/logstash/current/log… 

    …stash-8-11-0.html) and beats (https://www.elastic.co/guide/en/beats/libbeat/current/release-notes-8.11.0.html) to v8.11.0
    @mmguero
    mmguero committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    326b8f6 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Fluent-bit to v2.2.0 (https://github.com/fluent/fluent-bit/releases/t… 

    …ag/v2.2.0)
    @mmguero
    mmguero committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    5dbb346 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. various updates for v23.11.0 development: 

    * replace master/slave with client/server for modbus (idaholab#291)
* modbus updates for icsnpp-modbus (idaholab#289)
* point some Zeek plugins back upstream
* added new visualizations to modbus dashboard
    @mmguero
    mmguero committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    0a6565d View commit details
    Browse the repository at this point in the history

  2. Fix logstash parser issues with ldap (idaholab#289)

    @mmguero
    mmguero committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    61e3b6e View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. elasticsearch python libraries to 8.11.0

    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    3934eae View commit details
    Browse the repository at this point in the history

  2. idaholab#275, integrate suricata version of nsacyber ELITEWOLF rules

    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    baebc49 View commit details
    Browse the repository at this point in the history

  3. added https://github.com/reversinglabs/reversinglabs-yara-rules yara … 

    …rule set
    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    b0826dd View commit details
    Browse the repository at this point in the history

  4. update logstash and beats to 8.11.1

    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    99afed6 View commit details
    Browse the repository at this point in the history

  5. Work in progress for idaholab#287

    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    9b1253a View commit details
    Browse the repository at this point in the history

  6. better startup for netbox restore

    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    de41962 View commit details
    Browse the repository at this point in the history

  7. fix idaholab#287; fix issue with SUPERUSER_API_TOKEN not being set co… 

    …rrectly after netbox-restore
    @mmguero
    mmguero committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    48bca91 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. idaholab#286, strip out broken Arkime and NetBox links from dashboard… 

    …s for Kibana import
    @mmguero
    mmguero committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    fd6d050 View commit details
    Browse the repository at this point in the history

  2. idaholab#285, allow customizing Arkime's freeSpaceG setting (for PCAP… 

    … deletion) in an environment variable
    @mmguero
    mmguero committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    b7133e3 View commit details
    Browse the repository at this point in the history

  3. fix file type validation not working for upload from (some?) windows … 

    …browsers (idaholab#292) by removig front-end validation and just relying on the backend to do it
    @mmguero
    mmguero committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    684d69f View commit details
    Browse the repository at this point in the history

  4. improve error messages for PCAP/artifact processing beyond just icons, … 

    …idaholab#276
    @mmguero
    mmguero committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    f3c9872 View commit details
    Browse the repository at this point in the history

  5. idaholab#147, replace kbn_sankey with vega

    @mmguero
    mmguero committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a0dc39a View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. allow netbox to restore database from preload directory if it exists

    @mmguero
    mmguero committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    1ceddc7 View commit details
    Browse the repository at this point in the history

  2. documentation tweak for idaholab#294

    @mmguero
    mmguero committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    ea76ffb View commit details
    Browse the repository at this point in the history

  3. idaholab#294, put netbox restore database functionality inside contai… 

    …ner (still need to test K8s)
    @mmguero
    mmguero committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    d111631 View commit details
    Browse the repository at this point in the history

  4. bump opensearch-py to v2.4.0

    @mmguero
    mmguero committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    cdaf056 View commit details
    Browse the repository at this point in the history

  5. Revert "bump opensearch-py to v2.4.0" 

    This reverts commit cdaf056.
    @mmguero
    mmguero committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    ecf5599 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. opensearch-py to 2.4.1

    @mmguero
    mmguero committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    9d8861c View commit details
    Browse the repository at this point in the history

  2. idaholab#294, fix a minor bug when preload gz is not specified

    @mmguero
    mmguero committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    cba9dc9 View commit details
    Browse the repository at this point in the history

  3. for idaholab#280, on restore of an older database migrate ipam_vrf.na… 

    …me to ipam_prefix.description
    @mmguero
    mmguero committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    c2e6008 View commit details
    Browse the repository at this point in the history

  4. for idaholab#280, on restore of an older database migrate ipam_vrf.na… 

    …me to ipam_prefix.description (todo, need to do it in regular startup)
    @mmguero
    mmguero committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    b22ea96 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. bump opensearch-py to v2.4.2

    @mmguero
    mmguero committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    379054f View commit details
    Browse the repository at this point in the history

  2. idaholab#295, specify local networks via ZEEK_LOCAL_NETS environment … 

    …variable
    @mmguero
    mmguero committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    54d7c15 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. fix idaholab#294, put netbox restore database functionality inside co… 

    …ntainer for kubernetes
    @mmguero
    mmguero committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    301b2a7 View commit details
    Browse the repository at this point in the history

  2. restore kubernetes image names in prep for release

    @mmguero
    mmguero committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    95b3c2a View commit details
    Browse the repository at this point in the history

  3. for idaholab#299, fix a vim and libx11 vulnerability in a few package… 

    …s (by removing those dependencies which we don't really need)
    @mmguero
    mmguero committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    103da34 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. idaholab#280, update existing prefixes to VRF on startup for backward… 

    …s compatibility
    @mmguero
    mmguero committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    e5405bb View commit details
    Browse the repository at this point in the history

  2. rework y axis of results visualization

    @mmguero
    mmguero committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    2bd9578 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. update supercronic to v0.2.28 (https://github.com/aptible/supercronic… 

    …/releases/tag/v0.2.28)
    @mmguero
    mmguero committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    2808618 View commit details
    Browse the repository at this point in the history

  2. update supercronic to v0.2.28 (https://github.com/aptible/supercronic… 

    …/releases/tag/v0.2.28)
    @mmguero
    mmguero committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    ff81092 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. flesh out automatic config for virter

    @mmguero
    mmguero committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    0a1bf36 View commit details
    Browse the repository at this point in the history

  2. one minor tweak to idaholab#147, allow vega visualizations to import … 

    …for elasticsearch
    @mmguero
    mmguero committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    9059cf2 View commit details
    Browse the repository at this point in the history

  3. idaholab#301, allow configuration of docker's logging driver to preve… 

    …nt disk-exhaustion
    @mmguero
    mmguero committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    2331293 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. idaholab#302, allow user to include other suricata config YML files

    @mmguero
    mmguero committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    70684fb View commit details
    Browse the repository at this point in the history

  2. idaholab#303, allow user to include custom zeek config

    @mmguero
    mmguero committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    7338264 View commit details
    Browse the repository at this point in the history

  3. idaholab#303, allow user to include custom zeek config

    @mmguero
    mmguero committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    1a199dc View commit details
    Browse the repository at this point in the history

  4. idaholab#303, allow user to include custom zeek config

    @mmguero
    mmguero committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    3684c75 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. httpupdate netbox to v3.6.6 (https://github.com/netbox-community/netb… 

    …ox/releases/tag/v3.6.6)
    @mmguero
    mmguero committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    6861469 View commit details
    Browse the repository at this point in the history

  2. as it's Nov 30th and the fix for idaholab#298 isn't out yet, renaming… 

    … the release to v23.12.0
    @mmguero
    mmguero committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    b499390 View commit details
    Browse the repository at this point in the history

  3. documentation updates for idaholab#302 and idaholab#303, custom confi… 

    …guration for Suricata and Zeek
    @mmguero
    mmguero committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    e46b8d6 View commit details
    Browse the repository at this point in the history

  4. allow suricata config to tune max-pending-packets with SURICATA_MAX_P… 

    …ENDING_PACKETS variable
    @mmguero
    mmguero committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    33c655c View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. idaholab#298, bump opensearch to v2.11.1

    @mmguero
    mmguero committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    ad937ed View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. update branding/logos

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    f96a922 View commit details
    Browse the repository at this point in the history

  2. update/fix branding for v2.11.1

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    5ae973e View commit details
    Browse the repository at this point in the history

  3. update documentation SHA sums

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    36af1c1 View commit details
    Browse the repository at this point in the history

  4. fix issue with image name for kubernetes

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    da0886d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'development' of https://github.com/mmguero-dev/Malcolm … 

    …into v23.12.0_merge_cisagov
    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    ef9fd17 View commit details
    Browse the repository at this point in the history

  6. issue with K8s with zeek custom/intel

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    14970bd View commit details
    Browse the repository at this point in the history

  7. fix issue loading zeek intel on startup

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    7cc9e10 View commit details
    Browse the repository at this point in the history

  8. fix issue loading zeek intel on startup

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    acbe2d3 View commit details
    Browse the repository at this point in the history

  9. fix issue loading zeek intel on startup

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    39bdbd5 View commit details
    Browse the repository at this point in the history

  10. sha1sum update

    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    eca0c86 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'development' of https://github.com/mmguero-dev/Malcolm … 

    …into v23.12.0_merge_cisagov
    @mmguero
    mmguero committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    9bb1733 View commit details
    Browse the repository at this point in the history