Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Logs Onboarding] Install shipper: Standalone Elastic Agent #154937

Closed
gbamparop opened this issue Apr 13, 2023 · 3 comments · Fixed by #157802 or #158386
Closed

[Logs Onboarding] Install shipper: Standalone Elastic Agent #154937

gbamparop opened this issue Apr 13, 2023 · 3 comments · Fixed by #157802 or #158386
Assignees
@yngrdyn @ogupte
Labels
8.9 candidate apm:test-plan-done Pull request that was successfully tested during the test plan Feature:Logs Onboarding Logs Onboarding feature Feature: Observability Onboarding Team:obs-ux-logs Observability Logs User Experience Team

Comments

@gbamparop
Copy link
Contributor

gbamparop commented Apr 13, 2023 •
edited by isaclfreire
Loading

This page will include the instructions to install a standalone Elastic Agent and will provide an agent policy taking into account the configurations from the previous steps of the onboarding flow.

[Screenshot updated on 03/05 by @isaclfreire]
Custom logs:
Image

System logs:
Image

Links
@gbamparop gbamparop added Team:APM - DEPRECATED Use Team:obs-ux-infra_services. apm:logs-onboarding labels Apr 13, 2023
@gbamparop gbamparop changed the title [APM] Instructions to install the Elastic Agent [Logs Onboarding] Install shipper: Standalone Elastic Agent Apr 17, 2023
ogupte added a commit to ogupte/kibana that referenced this issue Apr 27, 2023
@ogupte
[Logs onboarding] Install shipper for standalone Elastic Agent (elast…
f069b84 
…ic#154937)
@ogupte ogupte mentioned this issue Apr 27, 2023
Closed
@isaclfreire isaclfreire self-assigned this Apr 27, 2023
@isaclfreire isaclfreire changed the title [Logs Onboarding] Install shipper: Standalone Elastic Agent [Design] Install shipper: Standalone Elastic Agent Apr 27, 2023
@gbamparop gbamparop changed the title [Design] Install shipper: Standalone Elastic Agent [Logs Onboarding] Install shipper: Standalone Elastic Agent May 12, 2023
@gbamparop gbamparop assigned ogupte and unassigned isaclfreire May 12, 2023
ogupte added a commit to ogupte/kibana that referenced this issue May 15, 2023
@ogupte
[Logs Onboarding] Adds install shipper step for custom logs (elastic#…
d406d25 
…154937) (WIP)
@ogupte ogupte mentioned this issue May 15, 2023
Merged
@yngrdyn yngrdyn self-assigned this May 23, 2023
yngrdyn added a commit that referenced this issue May 23, 2023
@ogupte @kibanamachine @yngrdyn
[Logs Onboarding] Adds install shipper step for custom logs (#157802)
12401b2 
Closes #154937

This PR includes the steps to install standalone elastic agent +
reporting the status from bash script back to kibana.

![Screenshot 2023-05-15 at 5 02 29
PM](https://github.com/elastic/kibana/assets/1967266/62484fb3-e02f-410d-aa7a-86bcc4dc0b03)

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Yngrid Coello <yngrid.coello@elastic.co>
Co-authored-by: Yngrid Coello <yngrdyn@gmail.com>
@yngrdyn yngrdyn mentioned this issue May 24, 2023
Merged
ogupte added a commit that referenced this issue May 25, 2023
@yngrdyn @ogupte @kibanamachine
[Logs Onboarding] Adds install shipper step for custom logs (#158386)
b2f0f4e 
Closes #154937

This PR is an extension of
[#157802](#157802) which was
reverted because public Api endpoint versioning problems.

![Screenshot 2023-05-15 at 5 02 29
PM](https://github.com/elastic/kibana/assets/1967266/62484fb3-e02f-410d-aa7a-86bcc4dc0b03)

---------

Co-authored-by: Oliver Gupte <oliver.gupte@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
delanni pushed a commit to delanni/kibana that referenced this issue May 25, 2023
@ogupte @kibanamachine
@yngrdyn @delanni
[Logs Onboarding] Adds install shipper step for custom logs (elastic#…
8299be4 
…157802)

Closes elastic#154937

This PR includes the steps to install standalone elastic agent +
reporting the status from bash script back to kibana.

![Screenshot 2023-05-15 at 5 02 29
PM](https://github.com/elastic/kibana/assets/1967266/62484fb3-e02f-410d-aa7a-86bcc4dc0b03)

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Yngrid Coello <yngrid.coello@elastic.co>
Co-authored-by: Yngrid Coello <yngrdyn@gmail.com>
ogupte added a commit to ogupte/kibana that referenced this issue May 25, 2023
@ogupte
Squashed commit of the following:
e797378 
commit e682ce1c3f5ddc84f779e0b331553769525b0bd9
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Wed May 24 15:49:49 2023 -0400

    small updates to setup script

commit 20d5f017307ee683e9081d408e26135784db86bf
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Wed May 24 12:36:54 2023 +0200

    Fix build

commit 969f7d84d34183ba99c836d10e4fb31268e7f989
Merge: f262843c83a d1be1d405f2
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Wed May 24 11:19:47 2023 +0200

    Merge branch '154936-logs-onboarding-onboarding-status-report-page' of github.com:ogupte/kibana into 154936-logs-onboarding-onboarding-status-report-page

commit f262843c83a1b97aec7f8b23700b77052cc7d141
Merge: 17f2fd8442c ea99b9b
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Wed May 24 10:56:06 2023 +0200

    Merge remote-tracking branch 'origin/logs-onboarding-standalone-elastic-agent-154937' into 154936-logs-onboarding-onboarding-status-report-page

commit ea99b9b
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Wed May 24 10:44:52 2023 +0200

    Adding version to public api endpoints

commit ee20beb
Merge: 0ed45fe acdadf2
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Wed May 24 09:51:17 2023 +0200

    Merge remote-tracking branch 'origin/master' into logs-onboarding-standalone-elastic-agent-154937

commit d1be1d405f2c20e7008b867cd423cf467353e6d5
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Wed May 24 00:27:56 2023 -0400

    adds a polling progress check and updates the setup script

commit 79c914ab0237332920b21b4c1096d80c7ca58b55
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Tue May 23 16:07:36 2023 -0400

    adds versioning to public apis

commit 86481286f977b1b3dac73aac0504e54f5a40b6cb
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 16:47:20 2023 +0200

    Getting state from server

commit d0523f96b96337bc62cc61cde91ef22fb443631f
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 16:19:30 2023 +0200

    Adding inspect button + redirecting to logs stream

commit 17f2fd8442c6d493ae629243da914263cddc2a88
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 16:47:20 2023 +0200

    Getting state from server

commit 3139dae1e0f5cc1d4367c5ae94beac87bdf0ed4c
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 16:19:30 2023 +0200

    Adding inspect button + redirecting to logs stream

commit 0ed45fe
Merge: db0fc5f 84d070d
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 13:09:49 2023 +0200

    Merge branch 'main' into logs-onboarding-standalone-elastic-agent-154937

commit db0fc5f
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Tue May 23 10:19:56 2023 +0200

    Fixing build

commit e7b8d0d
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Mon May 22 16:52:24 2023 -0400

    - adds API that checks for existence of log events for given dataset
    - cleans up some routes

commit f7d0b44
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Mon May 22 15:20:21 2023 -0400

    uses the static asset path provided for plugins for the downloaded setup script

commit 678f9bd
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Mon May 22 11:54:03 2023 -0400

    updated saved object mapping for observability-onboarding-state

commit e559f5e
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Mon May 22 11:18:43 2023 -0400

    remove apiKeyId mapping and move progess up one level in saved object mapping

commit 7eb32a8
Author: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Date:   Mon May 22 15:00:09 2023 +0000

    [CI] Auto-commit changed files from 'node scripts/check_mappings_update --fix'

commit 8c8a83a
Author: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Date:   Mon May 22 14:39:45 2023 +0000

    [CI] Auto-commit changed files from 'node scripts/lint_ts_projects --fix'

commit 58c70ac
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Mon May 22 16:01:19 2023 +0200

    Fixing build

commit 0834913
Merge: 385cc2e 9b50ae9
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Mon May 22 15:48:09 2023 +0200

    Merge remote-tracking branch 'origin/master' into logs-onboarding-standalone-elastic-agent-154937

commit 385cc2e
Merge: 28bc0fa 9b9d8cb
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Mon May 22 15:45:59 2023 +0200

    Merge remote-tracking branch 'origin/master' into logs-onboarding-standalone-elastic-agent-154937

commit 28bc0fa
Merge: aba20b5 2dce880
Author: Yngrid Coello <yngrdyn@gmail.com>
Date:   Mon May 22 15:43:10 2023 +0200

    Merge pull request #7 from ogupte/logs-onboaring-yaml-generator

    [Logs onboarding] Generating yaml configuration in server

commit 2dce880
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Mon May 22 14:51:59 2023 +0200

    Using internal savedObjects client

commit 741ad36
Merge: f394807 aba20b5
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Mon May 22 14:26:03 2023 +0200

    Merge remote-tracking branch 'origin/logs-onboarding-standalone-elastic-agent-154937' into logs-onboaring-yaml-generator

commit aba20b5
Author: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Date:   Thu May 18 20:39:13 2023 +0000

    [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

commit b3bc425
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Thu May 18 16:33:05 2023 -0400

    - fixed premature API call from wizard when rendered for transition
    - add API to get latest onboarding state

commit dd472c8
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Thu May 18 14:34:17 2023 -0400

    set saved objects ids based on apikeyId

commit 6a36ead
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Thu May 18 13:23:37 2023 -0400

    Cleans up script and fixes progress updates to be saved in saved objects

commit f394807
Author: Yngrid Coello <yngrid.coello@elastic.co>
Date:   Thu May 18 16:36:15 2023 +0200

    Generating yaml configuration in server

commit e622f11
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Tue May 16 01:00:57 2023 -0400

    Adds new saved object type `observability-onboarding-state`

commit 6571f21
Author: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Date:   Mon May 15 21:45:00 2023 +0000

    [CI] Auto-commit changed files from 'node scripts/lint_ts_projects --fix'

commit aeb5aaf
Author: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Date:   Mon May 15 21:38:33 2023 +0000

    [CI] Auto-commit changed files from 'node scripts/eslint --no-cache --fix'

commit d406d25
Author: Oliver Gupte <oliver.gupte@elastic.co>
Date:   Mon May 15 16:59:34 2023 -0400

    [Logs Onboarding] Adds install shipper step for custom logs (elastic#154937) (WIP)
@alisonelizabeth
Copy link
Contributor

Hi @gbamparop! Are you familiar with the guided_onboarding plugin? It looks like what you are trying to build would be a good use case for this.

I see this issue is already closed, but please reach out to @elastic/platform-onboarding if you would like to discuss further. We're happy to set aside some time to chat about how you might be able to leverage this work. Thanks!

cc @dandreaj @osmanis

@gbamparop
Copy link
Contributor Author

Hi @alisonelizabeth, we are aware of the guided onboarding plugin, there is another discussion in this thread (internal).

@yngrdyn
Copy link
Contributor

yngrdyn commented Sep 12, 2023

This was tested in o11-test qa environment.

Opened a small issue to hide inspect button.

image

@yngrdyn yngrdyn added the apm:test-plan-done Pull request that was successfully tested during the test plan label Sep 12, 2023
@gbamparop gbamparop added Team:obs-ux-logs Observability Logs User Experience Team Feature:Logs Onboarding Logs Onboarding feature and removed Team:APM - DEPRECATED Use Team:obs-ux-infra_services. apm:logs-onboarding labels Oct 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yngrdyn yngrdyn

@ogupte ogupte

Labels
8.9 candidate apm:test-plan-done Pull request that was successfully tested during the test plan Feature:Logs Onboarding Logs Onboarding feature Feature: Observability Onboarding Team:obs-ux-logs Observability Logs User Experience Team
Projects
None yet
Milestone
No milestone
5 participants
@yngrdyn @ogupte @alisonelizabeth @gbamparop @isaclfreire