Issue using rules_kotlin as local_repository

[jeffzoch]

Been a few months since i used the rules locally but im running into two strange errors:

1. Unable to find package for @rkt_1_4//jvm:opts.bzl: The repository '@rkt_1_4' could not be resolved
2. If i specify a kotlin compiler release I get an error Error: 'dict' value has no field or method 'url_templates'

here is my workspace:

local_repository(
    name = "io_bazel_rules_kotlin",
    path = "../rules_kotlin",
)

load("@io_bazel_rules_kotlin//kotlin:dependencies.bzl", "kt_download_local_dev_dependencies")
kt_download_local_dev_dependencies()
# KOTLIN
load("@io_bazel_rules_kotlin//kotlin:repositories.bzl", "kotlin_repositories")

KOTLINC_RELEASE = {
    "version" : "1.5.20",
    "url_templates" : [
        "https://github.com/JetBrains/kotlin/releases/download/v{version}/kotlin-compiler-{version}.zip",
    ],
    "sha256" : "edf34263ddaabd48f7ec59661e4c0d1dc868462fd3a1ea323083d0e3e83a8a8b",
}

kotlin_repositories(compiler_release = KOTLINC_RELEASE)

register_toolchains("//tools/kotlin:kotlin_toolchain")

and here is my toolchain:

load(
    "@io_bazel_rules_kotlin//kotlin:core.bzl",
    "define_kt_toolchain",
    "kt_compiler_plugin",
    "kt_kotlinc_options",
)
load("@io_bazel_rules_kotlin//kotlin:jvm.bzl", "kt_jvm_library", "kt_javac_options")

KOTLIN_LANGUAGE_LEVEL = "1.4"

kt_kotlinc_options(
    name = "kotlinc_options",
    x_allow_result_return_type = True,
    x_inline_classes = True,
)

kt_javac_options(
    name = "default_javac_options",
)

define_kt_toolchain(
    name = "kotlin_toolchain",
    api_version = KOTLIN_LANGUAGE_LEVEL,  # "1.1", "1.2", or "1.3"
    javac_options = "//:default_javac_options",
    jvm_target = "1.8",  # "1.6", "1.8", "9", "10", "11", or "12",
    kotlinc_options = "//:kotlinc_options",
    language_version = KOTLIN_LANGUAGE_LEVEL,  # "1.1", "1.2", or "1.3"
    experimental_strict_kotlin_deps = "warn"
)

I am on the latest commit a73e838
Both seem related to the large versioning change added by @restingbull

[jeffzoch]

the 2nd issue seems to be due to the "version" provider not being exported.

[restingbull]

Apologies, did a bit of moving the deck chairs.

#571 should fix it, though the requirements for working from head have changed. This was due to --override_repository not completely removing the local_repository files.

[jeffzoch]

@restingbull i just tried out the latest changes with #547 and am still getting strange errors like:

ERROR: Error fetching repository: java.io.IOException: No WORKSPACE file found in /private/var/tmp/_bazel_j.zoch/8bdf7aad5539a314ee98a49e42674806/external/io_bazel_rules_kotlin_head
ERROR: error loading package '': Encountered error while reading extension file 'kotlin/repositories.bzl': no such package '@io_bazel_rules_kotlin//kotlin': no such package '@io_bazel_rules_kotlin_head//': No WORKSPACE file found in /private/var/tmp/_bazel_j.zoch/8bdf7aad5539a314ee98a49e42674806/external/io_bazel_rules_kotlin_head

despite never defining io_bazel_rules_kotlin_head anywhere.
Edit: I see that the _head is defined in release_archive but am not sure why the workspace cannot be found.

I followed the latest instructions on the readme and ran bazel build //:rules_kotlin_release

local_repository(
    name = "release_archive",
    path = "../rules_kotlin/src/main/starlark/release_archive",
)

load("@release_archive//:repository.bzl", "archive_repository")
archive_repository(
    name = "io_bazel_rules_kotlin",
)
...
load("@io_bazel_rules_kotlin//kotlin:repositories.bzl", "kotlin_repositories", "kotlinc_version")

kotlin_repositories(
    compiler_release = kotlinc_version(
        release = "1.5.20", # just the numeric version
        sha256 = "edf34263ddaabd48f7ec59661e4c0d1dc868462fd3a1ea323083d0e3e83a8a8b"
    )
)
register_toolchains("//tools/kotlin:kotlin_toolchain")

edit: tried not specifying custom toolchain or compiler distribution and same error occurs.

[Nikolas-LFDesigns]

Uh, it does really take some cunning but still the sequence i did doesn't seem to even try to execute a repository rule needed to build the rules.
Though my attempts were about trying to download an archive with http_archive (you know, sandboxing and stuff) like this:

http_archive(
    name = "io_bazel_rules_kotlin",
    strip_prefix = "rules_kotlin-fa0ff96cc78d3cdc4420fe8251c5b13b4d6a4923",
    type = "zip",
    urls = [
        "https://github.com/bazelbuild/rules_kotlin/archive/fa0ff96cc78d3cdc4420fe8251c5b13b4d6a4923.zip",
    ],
)

Then define a release archive with bzl:

load("@io_bazel_rules_kotlin//src/main/starlark/release_archive:repository.bzl", "archive_repository")

def kotlin_archive_repository(name):
    archive_repository(
        name = name,
        release_archive_target = Label("@io_bazel_rules_kotlin//:rules_kotlin_release"), # that bit is confusing, but is a key to override default `//:rules_kotlin_release` leading to my repo root
    )

and in WORKSPACE:

kotlin_archive_repository(name = "rules_kotlin"):

Leads to no error except banal "couldn't fetch, uh, IOException, go away" stuff:

ERROR: Error fetching repository: java.io.IOException: No WORKSPACE file found in [...]/external/rules_kotlin_head
ERROR: error loading package '': Encountered error while reading extension file 'kotlin/core.bzl': no such package '@rules_kotlin//kotlin': no such package '@rules_kotlin_head//': No WORKSPACE file found in [...]/external/rules_kotlin_head

Maybe I'm just missing something obvious?
My remaining toolchain configuration is pure like it was on old library versions:

load("@rules_kotlin//kotlin:core.bzl", "kt_register_toolchains")

kt_register_toolchains()

load("@rules_kotlin//kotlin:repositories.bzl", "kotlin_repositories")

kotlin_repositories()

(Yes, I removed "kt_download_local_dependencies" and built its dependencies into repository and it worked until now)

[restingbull]

I believe I made a bit of a mistake in setting the local-from-head -- Since the archive_repostory operates in a very "probably shouldn't be doing that space" Bazel doesn't know to update the external/<from head> repo.

I'm testing a fix that should handle that (track the local_repository as input to archive_repository).

Means while, try deleting (yes, I just recommended modifying files in bazel-. I'm going to a very warm place for saying that) the external/<from head> and external/< release_archive> directories.

[restingbull]

Try pulling #577 to see if it works.

[jeffzoch]

@restingbull with no modifications (ie deleting stuff from bazel-*) #577 is reporting the same error

ERROR: Error fetching repository: java.io.IOException: No WORKSPACE file found in /private/var/tmp/_bazel_j.zoch/8bdf7aad5539a314ee98a49e42674806/external/io_bazel_rules_kotlin_head
ERROR: error loading package '': Encountered error while reading extension file 'kotlin/repositories.bzl': no such package '@io_bazel_rules_kotlin//kotlin': no such package '@io_bazel_rules_kotlin_head//': No WORKSPACE file found in /private/var/tmp/_bazel_j.zoch/8bdf7aad5539a314ee98a49e42674806/external/io_bazel_rules_kotlin_head

I tried deleting bazel-bin/external/**/* and that didnt help (there was a few different dirs starting with "release_archive" but none of those worked either) @restingbull

[Nikolas-LFDesigns]

Any updates here?
Still not building as of d174c98

[oliviernotteghem]

Getting exact same error too, even after bazel clean --expunge

ERROR: error loading package '': Encountered error while reading extension file 'kotlin/repositories.bzl': no such package '@io_bazel_rules_kotlin//kotlin': no such package '@io_bazel_rules_kotlin_head//': No WORKSPACE file found in /private/var/tmp/_bazel_oliviern/91a99194e71852b0e089ca5cc1c48073/external/io_bazel_rules_kotlin_head

[restingbull]

I'm an idiot, and I apologize for this one. I've been snowed under a new annual planning process, so the rules have suffered.

I'll make it cleaner momentarily, but here is the workaround:

local_repository(
    name = "release_archive",
    path = "../rules_kotlin/src/main/starlark/release_archive",
)

load("@release_archive//:repository.bzl", "archive_repository")
archive_repository(
    name = "io_bazel_rules_kotlin",
    local_path = "../rules_kotlin" # needs to know where the head repo is. Should infer it from the release_archive repo.
)

[oliviernotteghem]

thanks @restingbull for fixing! Did the trick.

[Nikolas-LFDesigns]

@restingbull ok, that seem to work.. any way to force these building with http_archive instead of local_repository as a source? We are using latest stuff from the rules and hence have to build from source, we are using sanboxing as well and very prefer to not include some stray repository as a local_repository.

[restingbull]

@Nikolas-LFDesigns -- the rules really aren't prod quality at head. Being able to build them that way is intended for active development on the rules... Which isn't particularly hermetic.

That said, what is the usecase ya'll need that prevents working off the latest release?

[Nikolas-LFDesigns]

There were many updates that were not released, like plugin support, important bug fixes, kt_android_local_test, worker support and so on which we constantly use and have to be sure that support is continuous, nevermind the current release.