Skip to content

Commit 3f41c24

Browse files
add base 'write to scratch' content to Explore and Analyze
1 parent 109645f commit 3f41c24

File tree

6 files changed

+169
-7
lines changed

6 files changed

+169
-7
lines changed

explore-analyze/ai-assistant.md

+35-1
Original file line numberDiff line numberDiff line change
@@ -23,4 +23,38 @@ mapped_urls:
2323
% - [ ] ./raw-migrated-files/docs-content/serverless/security-ai-assistant.md
2424
% - [ ] ./raw-migrated-files/docs-content/serverless/ai-assistant-knowledge-base.md
2525

26-
$$$token-limits$$$
26+
$$$token-limits$$$
27+
28+
**AI Assistant** is a chat-based interactive tool that uses generative AI and ELSER, Elastic’s proprietary semantic search model, to help you with a variety of tasks related to Elasticsearch and Kibana, including:
29+
30+
- **Constructing queries**: Assists you in building queries to search and analyze your data, including converting queries from other languages to [ES|QL](query-filter/languages/esql-rest.md).
31+
- **Indexing data**: Guides you on how to index data into Elasticsearch.
32+
- **Using APIs**: Calls Elasticsearch APIs on your behalf if you need specific operations performed.
33+
- **Generating sample data**: Helps you create sample data for testing and development purposes.
34+
- **Visualizing and analyzing data**: Assists you in creating visualizations and analyzing your data using Kibana.
35+
- **Troubleshooting**: Explains errors, messages, and suggests remediation.
36+
37+
AI Assistant requires specific privileges and a generative AI connector.
38+
39+
% Check [Configure AI Assistant](../deploy-manage/) for more details on how to enable and configure it.
40+
41+
The capabilities and ways to interact with AI Assistant can differ for each solution. Find more information in the respective solution docs:
42+
43+
% - [AI Assistant for Search](../solutions/search/)
44+
- [AI Assistant for Observability](../solutions/observability/observability-ai-assistant.md)
45+
- [AI Assistant for Security](../solutions/security/ai/ai-assistant.md)
46+
47+
## Prompt best practices [rag-for-esql]
48+
Elastic AI Assistant allows you to take full advantage of the Elastic platform to improve your operations. It can help you write an ES|QL query for a particular use case, or answer general questions about how to use the platform. Its ability to assist you depends on the specificity and detail of your questions. The more context and detail you provide, the more tailored and useful its responses will be.
49+
50+
To maximize its usefulness, consider using more detailed prompts or asking for additional information. For instance, after asking for an ES|QL query example, you could ask a follow-up question like, “Could you give me some other examples?” You can also ask for clarification or further exposition, for example "Please provide comments explaining the query you just gave."
51+
52+
In addition to practical advice, AI Assistant can offer conceptual advice, tips, and best practices for enhancing your security measures. You can ask it, for example:
53+
54+
- “How do I set up a machine learning job in Elastic Security to detect anomalies in network traffic volume over time?”
55+
- “I need to monitor for unusual file creation patterns that could indicate ransomware activity. How would I construct this query using EQL?”
56+
57+
## Your data and AI Assistant [ai-assistant-data-information]
58+
Elastic does not use customer data for model training. This includes anything you send the model, such as alert or event data, detection rule configurations, queries, and prompts. However, any data you provide to AI Assistant will be processed by the third-party provider you chose when setting up the generative AI connector as part of the assistant setup.
59+
60+
Elastic does not control third-party tools, and assumes no responsibility or liability for their content, operation, or use, nor for any loss or damage that may arise from your using such tools. Please exercise caution when using AI tools with personal, sensitive, or confidential information. Any data you submit may be used by the provider for AI training or other purposes. There is no guarantee that the provider will keep any information you provide secure or confidential. You should familiarize yourself with the privacy practices and terms of use of any generative AI tools prior to use.

explore-analyze/alerts.md

+24-1
Original file line numberDiff line numberDiff line change
@@ -15,4 +15,27 @@ mapped_urls:
1515

1616
$$$alerting-concepts-actions$$$
1717

18-
$$$alerting-concepts-conditions$$$
18+
$$$alerting-concepts-conditions$$$
19+
20+
Alerting tools in Elasticsearch and Kibana provide functionality to monitor data and notify you about significant changes or events in real time. This page provides an overview of how the key components work.
21+
22+
## Alerts
23+
Alerts are notifications generated when specific conditions are met. These notifications are sent to you through channels that you previously set such as email, Slack, webhooks, PagerDuty, and so on. Alerts are created based on rules, which define the criteria for triggering them. Rules monitor the data indexed in Elasticsearch and evaluate conditions on a defined schedule to identify matches. For example, a threshold rule can generate an alert when a value crosses a specific threshold, while a machine learning rule activates an alert when an anomaly detection job identifies an anomaly.
24+
25+
## Cases
26+
Cases are a collaboration and tracking tool, which is particularly useful for incidents or issues that arise from alerts. You can group related alerts into a case for easier management, add notes and comments to provide context, track investigation progress, and assign cases to team members or link them to external systems. Cases ensure that teams have a central place to track and resolve alerts efficiently.
27+
28+
## Maintenance windows
29+
If you have a planned outage, maintenance windows prevent rules from generating notifications in that period. Alerts still occur but their notifications are suppressed.
30+
31+
### Workflow Example
32+
33+
1. **Rule Creation**: You set up a rule to monitor server logs for failed login attempts exceeding 5 within a 10-minute window.
34+
1. **Alert Generation**: When the rule's condition is met, an alert is created.
35+
1. **Notification**: The alert runs an action, such as sending a Slack message or an email, unless a maintenance window is active.
36+
1. **Case Management**: If the alert is part of an ongoing investigation, it's added to a case for further analysis and resolution.
37+
38+
By combining these tools, Elasticsearch and Kibana enable incident response workflows, helping teams to detect, investigate, and resolve issues efficiently.
39+
40+
## Watcher
41+
You can use Watcher for alerting and monitoring specific conditions in your data. It enables you to define rules and take automated actions when certain criteria are met. Watcher is a powerful alerting tool for custom use cases and more complex alerting logic. It allows advanced scripting using Painless to define complex conditions and transformations.

explore-analyze/index.md

+59
Original file line numberDiff line numberDiff line change
@@ -16,3 +16,62 @@ mapped_urls:
1616
% Internal links rely on the following IDs being on this page (e.g. as a heading ID, paragraph ID, etc):
1717

1818
$$$elasticsearch-explore-your-data-visualizations-save-to-the-visualize-library$$$
19+
20+
The Elasticsearch platform and its UI, also known as Kibana, provide a comprehensive suite of tools to help you search, interact with, explore, and analyze your data effectively. These features empower you to gain deep insights, uncover trends, and take actionable steps based on your findings. This page is an overview of the key capabilities.
21+
22+
## Querying and filtering
23+
Elasticsearch’s robust query capabilities enable you to retrieve specific data from your datasets. Using the Query DSL (Domain Specific Language), you can build powerful, flexible queries that support:
24+
25+
- Full-text search
26+
- Boolean logic
27+
- Fuzzy matching
28+
- Proximity searches
29+
- Semantic search
30+
- …and more.
31+
32+
These tools simplify refining searches and pinpointing relevant information in real-time.
33+
34+
## Scripting
35+
Scripting makes custom data manipulation and transformation possible during search and aggregation processes. Using scripting languages like Painless, you can calculate custom metrics, perform conditional logic, or adjust data dynamically in search time. This flexibility ensures tailored insights specific to your needs.
36+
37+
## Aggregations
38+
Aggregations provide advanced data analysis, enabling you to extract actionable insights. With aggregations, you can calculate statistical metrics (for example, sums, averages, medians), group data into buckets (histograms, terms, and so on), or perform nested and multi-level analyses. Aggregations transform raw data into structured insights with ease.
39+
40+
## Geospatial Analysis
41+
The geospatial capabilities enable analysis of location-based data, including distance calculations, polygon and bounding box queries, and geohash grid aggregations. This functionality is necessary for logistics, real estate, and IoT industries, where location matters.
42+
43+
## Machine Learning
44+
Elasticsearch integrates machine learning for proactive analytics, helping you to:
45+
- Detect anomalies in time-series data
46+
- Forecast future trends
47+
- Analyze seasonal patterns
48+
- Perform powerful NLP operations such as semantic search
49+
- Machine learning models simplify complex predictive tasks, unlocking new opportunities for optimization.
50+
51+
## Discover
52+
Discover lets you interact directly with raw data. Use Discover to:
53+
- Browse documents in your indices
54+
- Apply filters and search queries
55+
- Visualize results in real-time
56+
57+
It’s the starting point for exploratory analysis.
58+
59+
## Dashboards
60+
Dashboards serve as centralized hubs for visualizing and monitoring data insights. With Dashboards, you can:
61+
- Combine multiple visualizations into a single, unified view
62+
- Display data from multiple indices or datasets for comprehensive analysis
63+
- Customize layouts to suit specific workflows and preferences
64+
65+
Dashboards provide an interactive and cohesive environment to explore trends and metrics at a glance.
66+
67+
## Panels and visualizations
68+
Panels and visualizations are the core elements that populate your dashboards, enabling dynamic data representation. They support diverse chart types, Interactive filtering, and drill-down capabilities to explore data further. These building blocks transform raw data into clear, actionable visuals, allowing users to analyze and interpret results effectively.
69+
70+
## Reporting and sharing
71+
You can share your work and findings with colleagues and stakeholders or generate reports. Report generation can be scheduled or on-demand. You can choose from multiple formats (for example, PDF, CSV). These tools ensure that actionable insights reach the right people at the right time.
72+
Alerting
73+
You can set up alerts to monitor your data continuously. Alerts notify you when specific conditions are met. This ensures timely action on critical issues.
74+
75+
## Bringing it all together
76+
Elasticsearch's features integrate seamlessly, offering an end-to-end solution for exploring, analyzing, and acting on data. If you want to explore any of the listed features in greater depth, refer to their respective documentation pages and check the provided hands-on examples and tutorials.
77+

explore-analyze/query-filter/filtering.md

+42-2
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ mapped_urls:
44
- https://www.elastic.co/guide/en/kibana/current/set-time-filter.html
55
---
66

7-
# Filtering
7+
# Filtering in Kibana
88

99
% What needs to be done: Write from scratch
1010

@@ -15,4 +15,44 @@ mapped_urls:
1515

1616
% Internal links rely on the following IDs being on this page (e.g. as a heading ID, paragraph ID, etc):
1717

18-
$$$_finding_your_apps_and_objects$$$
18+
$$$_finding_your_apps_and_objects$$$
19+
20+
This page describes the common ways Kibana offers in most apps for filtering data and refining your initial search queries.
21+
22+
Some apps provide more options, such as [Dashboards](../dashboards.md).
23+
24+
## Time filter [set-time-filter]
25+
26+
Display data within a specified time range when your index contains time-based events, and a time-field is configured for the selected [{{data-source}}](../find-and-organize/data-views.md). The default time range is 15 minutes, but you can customize it in [Advanced Settings](https://www.elastic.co/guide/en/kibana/current/advanced-options.html).
27+
28+
1. Click ![calendar icon](../../../images/kibana-time-filter-icon.png "").
29+
2. Choose one of the following:
30+
31+
* **Quick select**. Set a time based on the last or next number of seconds, minutes, hours, or other time unit.
32+
* **Commonly used**. Select a time range from options such as **Last 15 minutes**, **Today**, and **Week to date**.
33+
* **Recently used date ranges**. Use a previously selected data range.
34+
* **Refresh every**. Specify an automatic refresh rate.
35+
36+
:::{image} ../../../images/kibana-time-filter.png
37+
:alt: Time filter menu
38+
:width: 300px
39+
:::
40+
41+
3. To set start and end times, click the bar next to the time filter. In the popup, select **Absolute**, **Relative** or **Now**, then specify the required options.
42+
43+
:::{image} ../../../images/kibana-time-relative.png
44+
:alt: Time filter showing relative time
45+
:class: screenshot
46+
:::
47+
48+
The global time filter limits the time range of data displayed. In most cases, the time filter applies to the time field in the data view, but some apps allow you to use a different time field.
49+
50+
Using the time filter, you can configure a refresh rate to periodically resubmit your searches.
51+
52+
To manually resubmit a search, click the **Refresh** button. This is useful when you use Kibana to view the underlying data.
53+
54+
## Additional filters [autocomplete-suggestions]
55+
56+
Structured filters are a more interactive way to create {{es}} queries, and are commonly used when building dashboards that are shared by multiple analysts. Each filter can be disabled, inverted, or pinned across all apps. Each of the structured filters is combined with AND logic on the rest of the query.
57+
58+
![Add filter popup](../../../images/kibana-add-filter-popup.png "")

explore-analyze/query-filter/tools.md

+8-2
Original file line numberDiff line numberDiff line change
@@ -5,12 +5,18 @@ mapped_pages:
55

66
# Query tools [devtools-kibana]
77

8-
**Dev Tools** contains tools that you can use to interact with your data.
8+
Elasticsearch offers tools that you can use to query your data, manage those queries, and optimize them to be as efficient as possible.
99

1010
| | |
1111
| --- | --- |
12-
| [Console](tools/console.md) | Interact with the REST APIs of {{es}} and {{kib}}, including sending requestsand viewing API documentation. |
12+
| [Saved queries](tools/saved-queries.md) | Save your searches and queries to reuse them later. |
13+
| [Console](tools/console.md) | Interact with the REST APIs of {{es}} and {{kib}}, including sending requests and viewing API documentation. |
1314
| [{{searchprofiler}}](tools/search-profiler.md) | Inspect and analyze your search queries. |
1415
| [Grok Debugger   ](tools/grok-debugger.md) | Build and debug grok patterns before you use them in your data processing pipelines. |
1516
| [Painless Lab](../scripting/painless-lab.md) | [beta] Test and debug Painless scripts in real-time. |
17+
| [Playground](tools/playground.md) | Combine your Elasticsearch data with the power of large language models (LLMs) for retrieval augmented generation (RAG), using a chat interface. |
18+
19+
20+
21+
1622

explore-analyze/query-filter/tools/playground.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,6 @@ Use the Search Playground to test and edit {{es}} queries visually in the UI. Th
1010
Find Playground in the {{es-serverless}} UI under **{{es}} > Build > Playground**.
1111

1212
::::{note}
13-
ℹ️ The Playground documentation currently lives in the [{{kib}} docs](../../../solutions/search/rag/playground.md).
13+
ℹ️ For more details, check the full [Playground documentation](../../../solutions/search/rag/playground.md).
1414

1515
::::

0 commit comments

Comments
 (0)