Skip to content

feat(cloud): add support for Japanese Toshiba IOLife devices #301

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

audunmg
Copy link

@audunmg audunmg commented Sep 23, 2024

Not intended to be merged, but opening a PR to show this is being worked on (slowly), and maybe attract comments and help.

For now, the cloud functions are working (except the one to download lua files, and i suspect that will never work), but that's the only working thing.

The local protocol to actually communicate with the devices is not working at all (yet).

Copy link
Contributor

coderabbitai bot commented Sep 23, 2024

Important

Review skipped

Auto reviews are limited to specific labels.

Labels to auto review (6)
  • misc
  • bug
  • configuration
  • dependencies
  • enhancement
  • test

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share
Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    -- I pushed a fix in commit <commit_id>, please review it.
    -- Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    -- @coderabbitai generate unit testing code for this file.
    -- @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    -- @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    -- @coderabbitai read src/utils.ts and generate unit testing code.
    -- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    -- @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@audunmg audunmg marked this pull request as draft September 23, 2024 00:42
@rokam rokam changed the title WIP: Add support for Japanese Toshiba IOLife devices feat(cloud): add support for Japanese Toshiba IOLife devices Oct 16, 2024
@chemelli74
Copy link
Member

Hi, thank to so much for the contribution!

Please always use the correct env (devcontainer or use at least setup script) so you'll have the complete env for development and get the checks running locally.

@audunmg
Copy link
Author

audunmg commented Nov 11, 2024

After a lot of effort, I've realized that the lua files aren't fetched from the API at all, they are only distributed with the app, so the downloadLua will probably never work, at least not for my appliances.

It always returns 404 (when authenticated), and not 401, so that's maybe telling, and maybe it will work for someone else's Japanese Toshiba appliance.

I will extract the lua files from the app and start porting the protocol.

The list_appliances function work well, and I don't think there are more cloud functions needed to get local support working.

Do you prefer to keep the vestigal download_lua function in case it's activated later, or should I just remove it from this PR?

@audunmg
Copy link
Author

audunmg commented Nov 11, 2024

Since you renamed this to feat(cloud), then maybe I should open a separate PR for parsing the protocol?

I'm looking forward to finally getting this working :)

@wuwentao
Copy link
Member

wuwentao commented Nov 17, 2024

@audunmg if you want to add a new cloud support, you should find out the cloud URL and params for this cloud URL, also include the cloud server URL for this cloud, then you can got a expected http 200 response from the server.
and lua file will be used for a device to init download from cloud server, then run this lua app in your app as a application.
so lua file always exist in server side and server can control the version with your device SN or SN8.
for example, the cloud server and download lua is different URL for smarthome and meiju app, so you can't always using the same URL with different cloud service.

I'm not familar with all the detail, but just try to read all the source code and exist feature, got this per my understand.
if there is something error, you can continue works with it.
and I'm currently on vacation, so my time is not very convenient these weeks.

@wuwentao
Copy link
Member

wuwentao commented Dec 9, 2024

@audunmg these id/key maybe works for you.

please check with MeijuCloud and SmartHomeCloud args, use these value for your TsmartLife cloud test.

SUPPORTED_CLOUDS = {


"setting_aboutUs_appName" : "TSmartLife",

APP_ID = "1000";
APP_KEY = "2f39d871a38a4841aab3be3837e39cf4";

CLIENT_TYPE = "1";

"https://mp-prod.appsmb.com/";
"https://mp-prod.appsmb.com/mas/v5/app/";
"https://mp-prod.appsmb.com/mas/v5/app/proxy?alias="




if https://mp-prod.appsmb.com/ can't works, maybe you can try with
https://mp-jp-prod.appsmb.com/

"https://mp-jp-prod.appsmb.com/";
"https://mp-jp-prod.appsmb.com/mas/v5/app/";
"https://mp-jp-prod.appsmb.com/mas/v5/app/proxy?alias="

thanks

@audunmg
Copy link
Author

audunmg commented Dec 12, 2024

Thanks! I will try at the first opportunity!

@audunmg
Copy link
Author

audunmg commented Dec 23, 2024

I was able to test, but my appliances doesn't seem to work with TSmartLife, but they work with the IOLife cloud.

I'm speculating that the TSmartgLife is for Toshiba appliances outside of Japan?

In any case, the IOlife cloud keys work and is able to get my list of appliances (with keys!), and I've verified that my IOLife app doesn't download lua files from the API.

I've been able to extract them some other way, so I'll make a separate PR with those files.

@wuwentao
Copy link
Member

@audunmg thanks for the info share.
I'm not sure with TsmartLife app.
and you can also try with SmartHome app, you don't need to add your device to Smarthome, just using Builtin account or you can register a new user(download lua).
anyway, IOLife can works for you device, token is the most important info than lua.

@audunmg
Copy link
Author

audunmg commented Dec 23, 2024

Correction: I thought i got keys, but i see now it's using the default keys instead and is not able to communicate with my applicance.
So far, the only successful cloud request i can do is list appliances. At least it does that successfully and shows custom names of my appliances.

@wuwentao
Copy link
Member

you can refer to config_flow, I have add a brief step description.
and all the source code should have comments, you can refer to it.
the first stage will try with user input cloud, if it can't work, will rollback to default built in account and cloud.
if both can't works, will return error.
https://github.com/wuwentao/midea_ac_lan/blob/master/custom_components/midea_ac_lan/config_flow.py

@audunmg
Copy link
Author

audunmg commented Dec 23, 2024

A lot has happened since i started this PR, and i forgot where i got stuck.

I did a rebase, and tested with python -m midealocal.cli discover -d

It's able to retrieve keys, and connect, but the protocol is wrong, and that's why I needed the lua files.
This is the error i get(with some messages leading up to it):

2024-12-23 06:10:26.466 DEBUG (MainThread) [midealocal.device] [24189258014223] Connecting to XXX:6444
2024-12-23 06:10:26.568 DEBUG (MainThread) [midealocal.device] [24189258014223] Connected
2024-12-23 06:10:26.569 DEBUG (MainThread) [midealocal.device] [24189258014223] Authentication handshaking
2024-12-23 06:10:26.666 DEBUG (MainThread) [midealocal.device] [24189258014223] Received auth response with 72 bytes: XXX
2024-12-23 06:10:26.666 DEBUG (MainThread) [midealocal.device] [24189258014223] Authentication success
2024-12-23 06:10:26.666 DEBUG (MainThread) [cli] Trying to connect with key: {'token': 'XXX', 'key': 'XXX'}
2024-12-23 06:10:26.666 DEBUG (MainThread) [midealocal.device] [24189258014223] Authentication handshaking
2024-12-23 06:10:26.729 DEBUG (MainThread) [midealocal.device] [24189258014223] Received auth response with 72 bytes: 8370004020XXX
2024-12-23 06:10:26.729 DEBUG (MainThread) [midealocal.device] [24189258014223] Authentication success
2024-12-23 06:10:26.729 DEBUG (MainThread) [cli] Trying to retrieve device attributes.
2024-12-23 06:10:26.730 DEBUG (MainThread) [midealocal.device] [24189258014223] refresh_status with cmds: [<midealocal.message.MessageQueryAppliance object at 0x71e40e730ad0>, <midealocal.devices.ac.message.MessageQuery object at 0x71e40f163ce0>, <midealocal.devices.ac.message.MessageNewProtocolQuery object at 0x71e40e5df5f0>, <midealocal.devices.ac.message.MessagePowerQuery object at 0x71e40e5df260>], check_protocol True
...
2024-12-23 06:10:34.736 ERROR (MainThread) [cli] Unable to retrieve device attributes.
Traceback (most recent call last):
  File "/srv/midealocal/cli.py", line 126, in discover
    dev.refresh_status(True)
  File "/srv/midealocal/device.py", line 384, in refresh_status
    raise NoSupportedProtocol
midealocal.device.NoSupportedProtocol

@wuwentao
Copy link
Member

@audunmg if you can get token and pass auth, it should finished about 70%-80%.

you need to add a new query msg to trigger your device response to this query and parse the response with a body class, and update the result to HA.
it should works for sensor data.

  1. you can use smarthome to download lua file
  2. or dig out the lua file download URL in your IOlife/ToshibaLife APP.
  3. you can also refer to current MeijuCloud and SmartHomeCloud, they are using different URL, you can have a try with these URL path.

@yuyuvn
Copy link

yuyuvn commented Feb 23, 2025

the lua file are attached in the app.
you can found it by check assets\lua in the apk.
but it was encrypted, we need to find aes key to decrypt it.

or we can try download from endpoint https://app.iolife.toshiba-lifestyle.com/v2/open/sdk/product/encrptedLuaGet
it seems IOLife is using this api (base on the application logs when use logcat)

note:
manufacturer_code=0008
src="203" (app_id="1203", a bit different with src)

@yuyuvn
Copy link

yuyuvn commented Feb 24, 2025

I have been able to decrypt the lua file attached in IOLife app 🎉

the decrypt code:

from Crypto.Cipher import AES
import binascii
import hashlib

def decrypt_file(input_file, key):
    # Generate MD5 hash and take first 16 chars
    key_bytes = hashlib.md5(key.encode()).hexdigest()[:16].encode()

    # Print the MD5 hash used as key
    print(f"Using key: {hashlib.md5(key.encode()).hexdigest()[:16]}")
    
    # Read encrypted data
    with open(input_file, 'r') as f:
        hex_str = f.read().strip()
        # Convert hex string to bytes
        encrypted_data = bytes([int(hex_str[i:i+2], 16) for i in range(0, len(hex_str), 2)])
    
    # Create cipher object and decrypt the data
    cipher = AES.new(key_bytes, AES.MODE_ECB)
    
    # Add PKCS5 padding if needed
    block_size = 16
    pad_length = block_size - (len(encrypted_data) % block_size)
    if pad_length < block_size:
        encrypted_data += bytes([pad_length] * pad_length)
        
    # Decrypt data
    decrypted_data = cipher.decrypt(encrypted_data)
    
    # Remove padding
    padding_length = decrypted_data[-1]
    decrypted_data = decrypted_data[:-padding_length]
    
    # Convert to string
    decrypted_text = decrypted_data.decode('utf-8')
    
    # Write decrypted data
    output_file = input_file + '.decrypted'
    with open(output_file, 'w') as f:
        f.write(decrypted_text)
    
    print(f"Decrypted file saved as: {output_file}")

# Decrypt the file
app_key = "<app key>"
input_file = "<input file>"

decrypt_file(input_file, app_key)

@yuyuvn
Copy link

yuyuvn commented Feb 24, 2025

T_0008_DB_30.lua.zip
T0xDB.zip

this is plugin and lua for my front machine wash. I can also decrypt there files

T_0008_51_4.lua
T_0008_AC_30.lua
T_0008_BF_8.lua
T_0008_CA_30.lua
T_0008_DA_2.lua
T_0008_EA_9.lua

honestly I don't know what to do next 🤔

@wuwentao
Copy link
Member

@yuyuvn thank you very much for your info.
first of all, like Meiju app or IOLife app, using V2 api, it's cloud service, not LAN api.

and current integration still using V1 API ,it's LAN service, but we need a token to control device, and we need to got this token from midea cloud.
once the token is valid to connect your device, you can use all the exist feature with v1 api.

if we can't got token, we can do nothing.
maybe V2 api is another solution, but current midealocal not support it.

@yuyuvn
Copy link

yuyuvn commented Feb 24, 2025

@wuwentao
Eventhough lua download can't be get via v1 api, I think other v1 api still assessable
I got same result with audunmg in his comment #301 (comment)

2025-02-24 16:37:35.059 DEBUG (MainThread) [midealocal.device] [24189257957914] Connecting to 192.168.1.11:6444
2025-02-24 16:37:35.075 DEBUG (MainThread) [midealocal.device] [24189257957914] Connected
2025-02-24 16:37:35.075 DEBUG (MainThread) [midealocal.device] [24189257957914] Authentication handshaking
2025-02-24 16:37:35.169 DEBUG (MainThread) [midealocal.device] [24189257957914] Received auth response with 72 bytes: ...
2025-02-24 16:37:35.169 DEBUG (MainThread) [midealocal.device] [24189257957914] Authentication success

I think I already got valid token to connect my device from the cloud.
I'm able to send a query request to device and got a message, and trying to parse it (the lua script for parse data is too long, therefore it take me some time)

2025-02-24 16:37:35.244 DEBUG (MainThread) [midealocal.device] [24189257957914] Sending: {'_device_type': <DeviceType.DB: 219>, '_message_type': <MessageType.query: 3>, '_body_type': <ListTypes.X00: 0>, '_message_protocol_version': 0, 'header': 'aa0bdb00000000000003', 'body': '00', 'message_type': 'query', 'body_type': '00', 'self': <midealocal.message.MessageQueryToshibaIolife object at 0x7fff5c8d81d0>}, query is True
2025-02-24 16:37:35.475 DEBUG (MainThread) [midealocal.devices.db] [24189257957914] Received: {'_device_type': <DeviceType.CC: 204>, '_message_type': <MessageType.default: 0>, '_body_type': <ListTypes.X00: 0>, '_message_protocol_version': 0, '_header': '55aacc333d0001db0000', '_body': <midealocal.message.MessageBody object at 0x7fff5c1f3910>, '_data': '<109 bytes data>', 'parser_list': [], 'header': '<20 bytes data>', 'body': '<109 bytes data>', 'message_type': 'default', 'body_type': '00', 'self': <midealocal.devices.db.message.MessageDBResponse object at 0x7fff5c1f35d0>}

@wuwentao
Copy link
Member

@yuyuvn yes, as v1 api should always exist in old firmware, and v1 api token should be get from midea cloud server, this is the root. in the same time.
if you can got a valid token, it should works well with v1 api.

@yuyuvn
Copy link

yuyuvn commented Feb 25, 2025

hey, I have a good news
after run lua script to parse response, I got this json:

{
  "status":{
    "operation_wash_dryer_dry_set":1,
    "rinse_mode":"off",
    "over_capacity":0,
    "remain_time":19882,
    "hot_water_fifteen":"off",
    "lock":"off",
    "process_info_dry":"yes",
    "dehydration_time":241,
    "default_dry":"energy_saving",
    "tub_high_hot":0,
    "drain_filter_care":0,
    "door_open":0,
    "wash_rinse":"none",
    "operation_wash_dryer_spin_time":0,
    "tub_auto_clean":"on",
    "detergent_remain":3,
    "begin_process_wash":"yes",
    "spin_rotate_adjust":0,
    "drain_bubble_protect":"on",
    "detergent_setting":"off",
    "process_info_rinse":"yes",
    "machine_status":"running",
    "ufb":"off",
    "app_course_number":0,
    "version":30,
    "command":"none",
    "function_type":"base",
    "water_high_temperature":0,
    "dry":241,
    "softner_name":99,
    "process_info_wash":"yes",
    "operation_dryer_dry_set":1,
    "energy_saving":"off",
    "begin_process_soft_keep":"yes",
    "rinse_pour":3,
    "operation_wash_time":14,
    "program":"mute",
    "operation_wash_spin_time":3,
    "process_info_soft_keep":"yes",
    "reservation_time_latest_min":40,
    "reservation_time_latest_hour":0,
    "begin_process_spin":"yes",
    "reservation_time_earliest_hour":9,
    "begin_process_dry":"yes",
    "time_sec":0,
    "reservation_time_earliest_min":10,
    "begin_process_rinse":"yes",
    "softner_measure":10,
    "operation_wash_dryer_rinse_times":3,
    "process_info_spin":"yes",
    "detergent_measure":10,
    "detergent_name":3,
    "time_hour":0,
    "softner_setting":"off",
    "softner_remain_explanation":2,
    "buzzer":"off",
    "softner_remain":3,
    "low_noise":"off",
    "time_min":46,
    "wash_time":14,
    "process_detail":3,
    "tub_water_exist":0,
    "detergent_remain_explanation":2,
    "remain_time_adjust":0,
    "dry_finish_adjust":0,
    "drain_filter_clean":0,
    "mode":"wash_dry",
    "operation_wash_dryer_time":14,
    "operation_wash_rinse_times":3,
    "temperature":0,
    "reservation_mode":0,
    "reservation_hour":6,
    "dry_filter_clean":0,
    "error":0,
    "fungus_protect":"off",
    "reservation_min":18
  }
}

and this is extractly what we need.

so I can confirm we already have everything we need, token and message format and how to parse response message.
we only need to implement new message encoder and message parser to support it 🎉

@yuyuvn
Copy link

yuyuvn commented Mar 1, 2025

8b3b998

this working in my local
to @audunmg: feel free to cherry-pick my commit to this PR if you think it help👍

@audunmg
Copy link
Author

audunmg commented Mar 20, 2025

@yuyuvn Thanks a lot and sorry about the long delay.

I don't think I have much time to complete the AC any time soon, and I wouldn't want to block your work, so I'm setting this to ready for review, and if you need more, I added you to my branch so you can control this PR too.

@audunmg audunmg marked this pull request as ready for review March 20, 2025 01:18
@wuwentao
Copy link
Member

@audunmg @yuyuvn
one more question:

async def get_cloud_keys(self, appliance_id: int) -> dict[int, dict[str, Any]]:

is this get_cloud_token API service available in IOLife cloud server?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants