HTTPUpdateServer does not update SPIFFS or LittleFS

[mrWheel]

Board

ESP32 Wrover Module

Device Description

Nothing, just the bare board

Hardware Configuration

Nothing

Version

v2.0.2

IDE Name

Arduino IDE

Operating System

macOS 12.2.1

Flash frequency

80MHz and 40MHz

PSRAM enabled

no

Upload speed

921600 and 230400

Description

Created both SPIFFS and LittleFS bin files.

Tried to upload using the WebUpdater example sketch

Got these error's while trying to upload LittleFS.bin:
Monitor:

Update: WebUpdater.littlefs.bin
Bad Size Given
.Bad Size Given

Browser:

Update error: Bad Size Given

Same errors while trying to upload SPIFFS.bin

Sketch

/*
  To upload through terminal you can use: curl -F "image=@firmware.bin" esp32-webupdate.local/update
*/

#include <WiFi.h>
#include <WiFiClient.h>
#include <WebServer.h>
#include <ESPmDNS.h>
#include <HTTPUpdateServer.h>

#ifndef STASSID
#define STASSID "xyz"
#define STAPSK  "secret"
#endif

const char* host = "esp32-webupdate";
const char* ssid = STASSID;
const char* password = STAPSK;

WebServer httpServer(80);
HTTPUpdateServer httpUpdater(true);

void setup(void) {

  Serial.begin(115200);
  Serial.println();
  Serial.println("Booting Sketch...");
  WiFi.mode(WIFI_AP_STA);
  WiFi.begin(ssid, password);

  while (WiFi.waitForConnectResult() != WL_CONNECTED) {
    WiFi.begin(ssid, password);
    Serial.println("WiFi failed, retrying.");
  }
  
  MDNS.begin(host);
  if (MDNS.begin("esp32")) {
    Serial.println("mDNS responder started");
  }


  httpUpdater.setup(&httpServer);
  httpServer.begin();

  MDNS.addService("http", "tcp", 80);

  Serial.print("IP address [");
  Serial.print(WiFi.localIP());
  Serial.println("]");
  Serial.printf("HTTPUpdateServer ready! Open http://%s.local/update in your browser\n", host);
}

void loop(void) {
  httpServer.handleClient();
}

Debug Message

no other debug info

Other Steps to Reproduce

Partition Scheme: "Default 4MB with spiffs (1.2MB APP/1.5MB SPIFFS)"

Updating the WebUpdater.ino.bin or other .ino.bin files without a problem.

I have checked existing issues, online documentation and the Troubleshooting Guide

• I confirm I have checked existing issues, online documentation and Troubleshooting guide.

[VojtechBartoska]

Hello, are you able to test your issue on development version 2.0.3-RC1 to check if this is still valid? You can take a look on Docs where is explained how to choose development release version in Arduino IDE.

[mrWheel]

@VojtechBartoska
Sorry for the delay.

Tested with 2.0.3-RC1, same result.

Used [Tools]->[ESP32 LittleFS Data Upload] to create a WebUpdater.littlefs.bin file

16:16:16.174 -> IP address [192.168.12.24]
16:16:16.174 -> HTTPUpdateServer ready! Open http://esp32-webupdate.local/update in your browser
16:17:08.883 -> Update: WebUpdater.littlefs.bin
16:17:08.883 -> Bad Size Given
16:17:08.883 -> .Bad Size Given

Then I user [Tools]->[ESP32 Sketch Data Upload] to create a WebUpdater.spiffs.bin file

16:19:30.751 -> Booting Sketch...
16:19:33.591 -> mDNS responder started
16:19:33.591 -> IP address [192.168.12.24]
16:19:33.591 -> HTTPUpdateServer ready! Open http://esp32-webupdate.local/update in your browser
16:22:58.507 -> Update: WebUpdater.spiffs.bin
16:22:58.507 -> Bad Size Given
16:22:58.507 -> .Bad Size Given

Update firmware still works:

16:17:08.883 -> .Bad Size Given
16:19:16.387 -> Update: WebUpdater.ino.bin
16:19:16.387 -> ............... lots of dots ...................Update Success: 751504
16:19:29.959 -> Rebooting...
16:19:30.097 -> ets Jun  8 2016 00:22:57

[VojtechBartoska]

Thanks for testing @mrWheel, I'm adding this to our Roadmap and we will take a look. :)

[nospam2k]

I'm not sure where things are on this but a simple fix is to just change HTTPUpdateServer.h as follows:

if (_serial_output)
    Serial.printf("Update: %s\n", upload.filename.c_str());
    if (upload.name == "filesystem") {
        >>>> if (!Update.begin(SPIFFS.totalBytes(), U_SPIFFS)) {//start with max available size <<<<
            if (_serial_output) Update.printError(Serial);
        }
    }
...

To:

if (!Update.begin(UPDATE_SIZE_UNKNOWN, U_SPIFFS)) {//start with max available size

[IoTManagerProject]

Good Day.
I also try to find way esp32 littlefs http update. Are you have any update regarding this issue? I transfer my project to esp32 little fs and now become so sad that no littlefs http OTA available...

[zekageri]

I'm using Async server for the update. Firmware is updating but LittleFs don't.
Here is the relevant part of my sketch:

Update.onProgress([this](unsigned int progress, unsigned int total){
    int percent = (progress * 100) / total;
    if( percent == latestUpdatePercent ){ return; }
    latestUpdatePercent = percent;
    debug.print(
        DEBUG_INFO,
        "Update progress: %d byte from total of %d bytes. Which is %d%%\n",
        progress, total, percent
    );
});

 /*
*   Handling the firmware or the file system upload.
*/
server->on("/firmware", HTTP_POST, [this](AsyncWebServerRequest *request) {},
    [this](AsyncWebServerRequest *request, const String &filename, size_t index, uint8_t *data, size_t len, bool final) {
        
    // Starting the update since the index is 0.
    if (!index) {
        final = !firmwareStart(request);
    }

    // Writing bytes to the partition.
    if (Update.write(data, len) != len) {
        final = true;
    }

    // Check if the final bytes are written.
    // End the update and respond accordingly.
    if (final) {
        if (!Update.end(true)) {
           firmwareError(request);
        }else{
           firmwareSuccess(request);
        }
     }
});


/*
*   Handling the start of the firmware update process.
*   Checks if the file is a LittleFs file or a firmware.
*   Client will send a flag indicating if it is a flash update or not
*   Client also sends the fileSize to be able to track the progress.
*/
boolean AdminSystem::firmwareStart(AsyncWebServerRequest *request){
    int command     = U_FLASH;
    int fileSize    = UPDATE_SIZE_UNKNOWN;
    if (request->hasArg("fileSize")) {
        fileSize = request->arg("fileSize").toInt();
    }
    if (request->hasArg("isFlash")) {
        boolean isFlash = request->arg("isFlash").toInt();
        if (isFlash) {
            command = U_SPIFFS;
        }
    }
    
    if ( !Update.begin( fileSize, command ) ) { return false; }
    sys.startFirmware();
    return true;
}

/*
*   Handling the success event.
*/
void AdminSystem::firmwareSuccess(AsyncWebServerRequest *request){
    request->onDisconnect([]{ sys.endFirmware(); sys.restart(); });
    request->send(200, "text/plain", "Success");
}

/*
*   Handling the error event.
*/
void AdminSystem::firmwareError(AsyncWebServerRequest *request){
    sys.endFirmware();
    request->send(500, "text/plain", "Error");
}

LittleFs update can't even start.
It says that Firmware upload ended.

[HugoML]

httpUpdate supports SPIFFS, but not LittleFS.
Need to add this to the feature request.

[mrWheel]

I'm not sure where things are on this but a simple fix is to just change HTTPUpdateServer.h as follows:

if (_serial_output)
    Serial.printf("Update: %s\n", upload.filename.c_str());
    if (upload.name == "filesystem") {
        >>>> if (!Update.begin(SPIFFS.totalBytes(), U_SPIFFS)) {//start with max available size <<<<
            if (_serial_output) Update.printError(Serial);
        }
    }
...

To:

if (!Update.begin(UPDATE_SIZE_UNKNOWN, U_SPIFFS)) {//start with max available size

Hm.. tried this but strange things happen after flashing LittleFS.

| Available LittleFS space [     0]kB
|            LittleFS Size [  1472]kB
|            LittleFS Used [1507328]bytes

.. which is not correct!